Max level shown:
12024-11-02T04:00:03.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 440e2402-8198-498c-8934-879335dba79e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
22024-11-02T04:00:03.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 440e2402-8198-498c-8934-879335dba79e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32024-11-02T04:00:03.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 440e2402-8198-498c-8934-879335dba79e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42024-11-02T04:00:03.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
52024-11-02T04:00:03.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62024-11-02T04:00:03.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
72024-11-02T04:00:03.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82024-11-02T04:00:03.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92024-11-02T04:00:03.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102024-11-02T04:00:03.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112024-11-02T04:00:03.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122024-11-02T04:00:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132024-11-02T04:00:03.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.001126ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142024-11-02T04:00:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152024-11-02T04:00:03.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-11-02T04:00:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-11-02T04:00:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-11-02T04:00:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-11-02T04:00:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-11-02T04:00:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
212024-11-02T04:00:03.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-11-02T04:00:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-11-02T04:00:03.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
242024-11-02T04:00:03.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.953865ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
252024-11-02T04:00:04.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bcfe6b5b-2a7f-45f1-967c-97ebf06987d4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
262024-11-02T04:00:04.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bcfe6b5b-2a7f-45f1-967c-97ebf06987d4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
272024-11-02T04:00:04.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bcfe6b5b-2a7f-45f1-967c-97ebf06987d4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
282024-11-02T04:00:05.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5f210bf-7873-4e47-b2f0-80906995ae12 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
292024-11-02T04:00:05.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5f210bf-7873-4e47-b2f0-80906995ae12 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
302024-11-02T04:00:05.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5f210bf-7873-4e47-b2f0-80906995ae12 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
312024-11-02T04:00:06.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b15aef4c-8581-4a61-9f62-8d9929da9c13 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
322024-11-02T04:00:06.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b15aef4c-8581-4a61-9f62-8d9929da9c13 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
332024-11-02T04:00:06.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b15aef4c-8581-4a61-9f62-8d9929da9c13 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
342024-11-02T04:00:07.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e821b81d-4b92-4548-9cd0-2812d4454353 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
352024-11-02T04:00:07.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e821b81d-4b92-4548-9cd0-2812d4454353 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
362024-11-02T04:00:07.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e821b81d-4b92-4548-9cd0-2812d4454353 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
372024-11-02T04:00:08.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6a38a356-f0a9-4933-839c-728bd421c891 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
382024-11-02T04:00:08.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6a38a356-f0a9-4933-839c-728bd421c891 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
392024-11-02T04:00:08.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6a38a356-f0a9-4933-839c-728bd421c891 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
402024-11-02T04:00:08.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1540 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = f16fe600-6c25-40f3-9b95-c5c2da7e0258 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
412024-11-02T04:00:09.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3efd488-bd9a-4c21-86c0-794be12f9434 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
422024-11-02T04:00:09.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3efd488-bd9a-4c21-86c0-794be12f9434 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
432024-11-02T04:00:09.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3efd488-bd9a-4c21-86c0-794be12f9434 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
442024-11-02T04:00:10.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 96141904-4b68-4815-b3ec-96f766139804 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
452024-11-02T04:00:10.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 96141904-4b68-4815-b3ec-96f766139804 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
462024-11-02T04:00:10.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 96141904-4b68-4815-b3ec-96f766139804 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
472024-11-02T04:00:11.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41534361-2ac9-45db-8fe6-5d69d036cf63 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
482024-11-02T04:00:11.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41534361-2ac9-45db-8fe6-5d69d036cf63 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
492024-11-02T04:00:11.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41534361-2ac9-45db-8fe6-5d69d036cf63 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
502024-11-02T04:00:12.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54be5095-a281-40df-8305-06fb7cc84be3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
512024-11-02T04:00:12.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54be5095-a281-40df-8305-06fb7cc84be3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
522024-11-02T04:00:12.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54be5095-a281-40df-8305-06fb7cc84be3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
532024-11-02T04:00:13.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fbc35f38-5d30-4c85-b33a-dad0b3d04fe2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
542024-11-02T04:00:13.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fbc35f38-5d30-4c85-b33a-dad0b3d04fe2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
552024-11-02T04:00:13.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fbc35f38-5d30-4c85-b33a-dad0b3d04fe2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
562024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
572024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
582024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
592024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
602024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
612024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
622024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
632024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
642024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
652024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
662024-11-02T04:00:13.539ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
672024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
682024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
692024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.381\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
702024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
712024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
722024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
732024-11-02T04:00:13.539ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:50:13.539629357 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
742024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
752024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
762024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
772024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
782024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
792024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
802024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
812024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
822024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
832024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
842024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
852024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
862024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
872024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
882024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
892024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
902024-11-02T04:00:13.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
912024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
922024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
932024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
942024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
952024-11-02T04:00:13.539ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
962024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
972024-11-02T04:00:13.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
982024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
992024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
1002024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1012024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
1022024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1032024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1042024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
1052024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1062024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
1072024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
1082024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1092024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1102024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1112024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1122024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1132024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1142024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1152024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1162024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1172024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1182024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1192024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1202024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1212024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1222024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1232024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1242024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1252024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1262024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1272024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1282024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
1292024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.88\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1302024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
1312024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
1322024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1332024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.821\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
1342024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
1352024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
1362024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1372024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.81\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
1382024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
1392024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1402024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1412024-11-02T04:00:13.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9517, tv_nsec: 518964401 } })
1422024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.51\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1432024-11-02T04:00:13.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9517, tv_nsec: 518959901 } })
1442024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1452024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1462024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1472024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1482024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1492024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1502024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1512024-11-02T04:00:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.177535ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1522024-11-02T04:00:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1532024-11-02T04:00:13.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1542024-11-02T04:00:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.339098ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1552024-11-02T04:00:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1562024-11-02T04:00:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1572024-11-02T04:00:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1582024-11-02T04:00:13.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9517, tv_nsec: 520884673 } })
1592024-11-02T04:00:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1602024-11-02T04:00:13.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
1612024-11-02T04:00:13.543ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:50:13.539629357 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1622024-11-02T04:00:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.279142ms iteration = 4 status = {"expiration":"2024-11-02T03:50:13.539629357Z","pruned":[]}
1632024-11-02T04:00:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.045137ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1642024-11-02T04:00:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1652024-11-02T04:00:13.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1662024-11-02T04:00:13.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9517, tv_nsec: 524951580 } })
1672024-11-02T04:00:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1682024-11-02T04:00:13.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1692024-11-02T04:00:13.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
1702024-11-02T04:00:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1712024-11-02T04:00:13.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1722024-11-02T04:00:13.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1732024-11-02T04:00:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1742024-11-02T04:00:13.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1752024-11-02T04:00:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1762024-11-02T04:00:13.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-11-02T04:00:13.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1782024-11-02T04:00:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1792024-11-02T04:00:13.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1802024-11-02T04:00:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1812024-11-02T04:00:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1822024-11-02T04:00:13.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1832024-11-02T04:00:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1842024-11-02T04:00:13.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852024-11-02T04:00:13.562ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.206886ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
1862024-11-02T04:00:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1872024-11-02T04:00:13.562ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1882024-11-02T04:00:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1892024-11-02T04:00:13.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1902024-11-02T04:00:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1912024-11-02T04:00:13.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1922024-11-02T04:00:13.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-11-02T04:00:13.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9517, tv_nsec: 548215390 } })
1942024-11-02T04:00:13.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
1952024-11-02T04:00:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1962024-11-02T04:00:13.570ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1972024-11-02T04:00:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1982024-11-02T04:00:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1992024-11-02T04:00:13.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-11-02T04:00:13.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2012024-11-02T04:00:13.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2022024-11-02T04:00:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2032024-11-02T04:00:13.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2042024-11-02T04:00:13.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2052024-11-02T04:00:13.582ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2062024-11-02T04:00:13.582ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 42.570114ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2072024-11-02T04:00:13.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082024-11-02T04:00:13.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-11-02T04:00:13.594ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2102024-11-02T04:00:13.594ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2112024-11-02T04:00:13.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2122024-11-02T04:00:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2132024-11-02T04:00:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2142024-11-02T04:00:13.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2152024-11-02T04:00:13.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2162024-11-02T04:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2172024-11-02T04:00:13.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2182024-11-02T04:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2192024-11-02T04:00:13.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2202024-11-02T04:00:13.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212024-11-02T04:00:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2222024-11-02T04:00:13.600ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2232024-11-02T04:00:13.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2242024-11-02T04:00:13.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2252024-11-02T04:00:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2262024-11-02T04:00:13.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2272024-11-02T04:00:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2282024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2292024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2302024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.709496ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2312024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2322024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2332024-11-02T04:00:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2342024-11-02T04:00:13.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2352024-11-02T04:00:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362024-11-02T04:00:13.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372024-11-02T04:00:13.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2382024-11-02T04:00:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2392024-11-02T04:00:13.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2402024-11-02T04:00:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2412024-11-02T04:00:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2422024-11-02T04:00:13.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432024-11-02T04:00:13.607ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442024-11-02T04:00:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2452024-11-02T04:00:13.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2462024-11-02T04:00:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2472024-11-02T04:00:13.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482024-11-02T04:00:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
2492024-11-02T04:00:13.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2502024-11-02T04:00:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2512024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2522024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2532024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2542024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2552024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2562024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2582024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2592024-11-02T04:00:13.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2602024-11-02T04:00:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2612024-11-02T04:00:13.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2622024-11-02T04:00:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2632024-11-02T04:00:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2642024-11-02T04:00:13.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2652024-11-02T04:00:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2662024-11-02T04:00:13.614ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2672024-11-02T04:00:13.614ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2682024-11-02T04:00:13.614ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.079731ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2692024-11-02T04:00:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.711632ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2702024-11-02T04:00:13.620ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.763145ms iteration = 3 status = {"nsuccess":5}
2712024-11-02T04:00:13.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2722024-11-02T04:00:13.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2732024-11-02T04:00:13.625ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2742024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2752024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2762024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2772024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2782024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2792024-11-02T04:00:13.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2802024-11-02T04:00:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2812024-11-02T04:00:13.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-11-02T04:00:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2832024-11-02T04:00:13.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2842024-11-02T04:00:13.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2852024-11-02T04:00:13.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2862024-11-02T04:00:13.643ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
2872024-11-02T04:00:13.643ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.491772ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
2882024-11-02T04:00:13.655ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2892024-11-02T04:00:13.655ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2902024-11-02T04:00:13.655ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.118244ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2912024-11-02T04:00:13.659ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2922024-11-02T04:00:13.659ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2932024-11-02T04:00:13.659ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.09974ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2942024-11-02T04:00:13.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2952024-11-02T04:00:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2962024-11-02T04:00:13.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-11-02T04:00:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
2982024-11-02T04:00:13.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2992024-11-02T04:00:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3002024-11-02T04:00:13.671ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3012024-11-02T04:00:13.671ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.705289ms iteration = 10 status = {"physical_disks_added":0}
3022024-11-02T04:00:13.671ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3032024-11-02T04:00:13.671ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3042024-11-02T04:00:13.671ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3052024-11-02T04:00:13.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3062024-11-02T04:00:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3072024-11-02T04:00:13.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082024-11-02T04:00:13.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3092024-11-02T04:00:13.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3102024-11-02T04:00:13.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3112024-11-02T04:00:13.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3122024-11-02T04:00:13.675ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.853587ms iteration = 7 status = 0
3132024-11-02T04:00:13.677ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3142024-11-02T04:00:13.677ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3152024-11-02T04:00:13.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3162024-11-02T04:00:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3172024-11-02T04:00:13.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3182024-11-02T04:00:13.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3192024-11-02T04:00:13.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3202024-11-02T04:00:13.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3212024-11-02T04:00:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3222024-11-02T04:00:13.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3232024-11-02T04:00:13.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3242024-11-02T04:00:13.685ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3252024-11-02T04:00:13.685ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3262024-11-02T04:00:13.685ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
3272024-11-02T04:00:13.685ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 145.517915ms iteration = 5 status = {"generation":1}
3282024-11-02T04:00:13.691ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3292024-11-02T04:00:13.691ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 151.519334ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3302024-11-02T04:00:13.706ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3312024-11-02T04:00:13.706ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
3322024-11-02T04:00:13.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3332024-11-02T04:00:13.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3342024-11-02T04:00:13.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352024-11-02T04:00:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3362024-11-02T04:00:13.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3372024-11-02T04:00:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3382024-11-02T04:00:13.713ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
3392024-11-02T04:00:13.713ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3402024-11-02T04:00:13.713ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
3412024-11-02T04:00:13.713ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 173.737861ms iteration = 5 status = {"generation":2}
3422024-11-02T04:00:13.715ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
3432024-11-02T04:00:13.715ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.478469ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3442024-11-02T04:00:13.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3452024-11-02T04:00:13.718ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3462024-11-02T04:00:13.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3472024-11-02T04:00:13.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b470f51b-7dfc-42f3-87eb-c98a1075b8bd", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
3482024-11-02T04:00:13.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3492024-11-02T04:00:13.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3502024-11-02T04:00:13.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-11-02T04:00:13.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3522024-11-02T04:00:13.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3532024-11-02T04:00:13.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3542024-11-02T04:00:13.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3552024-11-02T04:00:13.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562024-11-02T04:00:13.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3572024-11-02T04:00:13.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3582024-11-02T04:00:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3592024-11-02T04:00:13.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
3602024-11-02T04:00:13.748ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3612024-11-02T04:00:13.748ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c90e75-989b-4498-a335-777bb36f996f", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
3622024-11-02T04:00:13.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3632024-11-02T04:00:13.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
3642024-11-02T04:00:13.855ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3652024-11-02T04:00:13.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3662024-11-02T04:00:13.876ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3672024-11-02T04:00:13.877ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da5f92ed-b8e6-41ef-83f3-cb603d971a46", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
3682024-11-02T04:00:13.877ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3692024-11-02T04:00:13.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3702024-11-02T04:00:13.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3712024-11-02T04:00:13.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "134d9f25-92b8-4cbd-8ac4-5c08ec6ac66f", "content-length": "691", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
3722024-11-02T04:00:13.900ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3732024-11-02T04:00:13.900ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3742024-11-02T04:00:13.900ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3752024-11-02T04:00:13.901ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.996635ms iteration = 7 status = {}
3762024-11-02T04:00:13.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = a5a8c9e5-8a63-49e3-b175-511c3188210b roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
3772024-11-02T04:00:13.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = a5a8c9e5-8a63-49e3-b175-511c3188210b resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
3782024-11-02T04:00:13.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = a5a8c9e5-8a63-49e3-b175-511c3188210b response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
3792024-11-02T04:00:13.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 4e8ededb-048f-45b5-85d1-b139fad5c171 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
3802024-11-02T04:00:13.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 4e8ededb-048f-45b5-85d1-b139fad5c171 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
3812024-11-02T04:00:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a24b5306-6773-4ee4-be31-97d5658391fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3822024-11-02T04:00:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 4e8ededb-048f-45b5-85d1-b139fad5c171 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
3832024-11-02T04:00:13.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a24b5306-6773-4ee4-be31-97d5658391fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3842024-11-02T04:00:13.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a24b5306-6773-4ee4-be31-97d5658391fd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3852024-11-02T04:00:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 392.52495ms iteration = 7 status = {}
3862024-11-02T04:00:13.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3872024-11-02T04:00:14.019ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3882024-11-02T04:00:14.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3892024-11-02T04:00:14.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "84dfcb59-e44c-492a-910d-b921acdb3477", "content-length": "372", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
3902024-11-02T04:00:14.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3912024-11-02T04:00:14.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3922024-11-02T04:00:14.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3932024-11-02T04:00:14.032ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5102dbd0-eb28-4c18-a5d3-b6926880098b", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3942024-11-02T04:00:14.032ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3952024-11-02T04:00:14.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f4a4ebe7-9449-437d-8fc0-2bed4c1fafef", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3962024-11-02T04:00:14.034ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3972024-11-02T04:00:14.036ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3982024-11-02T04:00:14.036ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3992024-11-02T04:00:14.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 496.871861ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4002024-11-02T04:00:14.036ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f181204-703e-47c8-bf0b-058c6818712d", "content-length": "1", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4012024-11-02T04:00:14.038ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4022024-11-02T04:00:14.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4032024-11-02T04:00:14.041ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 501.764976ms iteration = 7 status = null
4042024-11-02T04:00:14.075ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4052024-11-02T04:00:14.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4062024-11-02T04:00:14.078ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4072024-11-02T04:00:14.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "952ace34-9058-4d85-9de2-4c3224b3b030", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4082024-11-02T04:00:14.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4092024-11-02T04:00:14.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4acf3530-0f59-4f3a-a298-979cd4d8394e", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4102024-11-02T04:00:14.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4112024-11-02T04:00:14.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "595ed30e-3484-4e25-9af0-119f05d778e9", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4122024-11-02T04:00:14.082ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4132024-11-02T04:00:14.083ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4142024-11-02T04:00:14.083ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.234058ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4152024-11-02T04:00:14.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4162024-11-02T04:00:14.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4172024-11-02T04:00:14.105ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
4182024-11-02T04:00:14.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4192024-11-02T04:00:14.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4202024-11-02T04:00:14.112ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4212024-11-02T04:00:14.112ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "10f50c21-8e53-4481-9c08-7438a084f61b", "content-length": "134", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4222024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4232024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
4242024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4252024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4262024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4272024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4282024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4292024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4302024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4312024-11-02T04:00:14.112ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4322024-11-02T04:00:14.113ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
4332024-11-02T04:00:14.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4342024-11-02T04:00:14.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4352024-11-02T04:00:14.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4362024-11-02T04:00:14.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "72953169-72e2-40bc-9e5d-eecd666f8bb2", "content-length": "2", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4372024-11-02T04:00:14.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4382024-11-02T04:00:14.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "71f19402-c7d5-4634-9e2c-4cc34fe31b12", "content-length": "52", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4392024-11-02T04:00:14.115ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
4402024-11-02T04:00:14.115ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4412024-11-02T04:00:14.148ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "68369a82-fb9c-425c-84dd-03116cf9f15a", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4422024-11-02T04:00:14.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4432024-11-02T04:00:14.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4442024-11-02T04:00:14.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4452024-11-02T04:00:14.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4462024-11-02T04:00:14.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4472024-11-02T04:00:14.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4482024-11-02T04:00:14.156ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4492024-11-02T04:00:14.157ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4502024-11-02T04:00:14.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5f7253e3-3b44-4aca-aa82-27e8072b102a", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4512024-11-02T04:00:14.159ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 619.680998ms iteration = 8 status = {}
4522024-11-02T04:00:14.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "095b3cfc-4569-4e40-ab65-4fdec566f70c", "date": "Sat, 02 Nov 2024 04:00:14 GMT"} })
4532024-11-02T04:00:14.235ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
4542024-11-02T04:00:14.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4552024-11-02T04:00:14.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ad2347a-7bfc-48d4-8143-6abd34dd688b", "content-length": "682", "date": "Sat, 02 Nov 2024 04:00:13 GMT"} })
4562024-11-02T04:00:14.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4572024-11-02T04:00:14.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4582024-11-02T04:00:14.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4592024-11-02T04:00:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4602024-11-02T04:00:14.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4612024-11-02T04:00:14.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4622024-11-02T04:00:14.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4632024-11-02T04:00:14.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4642024-11-02T04:00:14.251ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.277977ms iteration = 7 status = {}
4652024-11-02T04:00:14.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c09728a3-6afe-41dd-97db-8ba9c3c9c346 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4662024-11-02T04:00:14.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c09728a3-6afe-41dd-97db-8ba9c3c9c346 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4672024-11-02T04:00:14.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c09728a3-6afe-41dd-97db-8ba9c3c9c346 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4682024-11-02T04:00:15.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f47f2327-4c55-4761-b507-175e04aea834 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4692024-11-02T04:00:15.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f47f2327-4c55-4761-b507-175e04aea834 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4702024-11-02T04:00:15.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f47f2327-4c55-4761-b507-175e04aea834 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4712024-11-02T04:00:16.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 52c66a33-45dd-48e7-ad4e-9a2e7340a68b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4722024-11-02T04:00:16.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 52c66a33-45dd-48e7-ad4e-9a2e7340a68b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4732024-11-02T04:00:16.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 52c66a33-45dd-48e7-ad4e-9a2e7340a68b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4742024-11-02T04:00:17.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 521e4d77-5580-4227-8b8c-5455336f48ff roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4752024-11-02T04:00:17.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 521e4d77-5580-4227-8b8c-5455336f48ff resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4762024-11-02T04:00:17.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 521e4d77-5580-4227-8b8c-5455336f48ff response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4772024-11-02T04:00:18.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e33350c-e1da-4d40-98da-41aec6e4445a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4782024-11-02T04:00:18.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e33350c-e1da-4d40-98da-41aec6e4445a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4792024-11-02T04:00:18.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e33350c-e1da-4d40-98da-41aec6e4445a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4802024-11-02T04:00:19.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d120ff16-0d7b-42b7-be67-f400be600f6f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4812024-11-02T04:00:19.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d120ff16-0d7b-42b7-be67-f400be600f6f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4822024-11-02T04:00:19.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d120ff16-0d7b-42b7-be67-f400be600f6f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4832024-11-02T04:00:20.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dbf57b0-8616-4550-9a35-008d53d46308 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4842024-11-02T04:00:20.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dbf57b0-8616-4550-9a35-008d53d46308 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4852024-11-02T04:00:20.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dbf57b0-8616-4550-9a35-008d53d46308 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4862024-11-02T04:00:21.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6b81e1-a968-4aa7-b968-fa04d6aa9d65 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4872024-11-02T04:00:21.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6b81e1-a968-4aa7-b968-fa04d6aa9d65 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4882024-11-02T04:00:21.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6b81e1-a968-4aa7-b968-fa04d6aa9d65 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4892024-11-02T04:00:22.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = de75853f-33b6-4fb6-afdf-70bddf57da46 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4902024-11-02T04:00:22.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = de75853f-33b6-4fb6-afdf-70bddf57da46 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4912024-11-02T04:00:22.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = de75853f-33b6-4fb6-afdf-70bddf57da46 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
4922024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
4932024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
4942024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4952024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4962024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4972024-11-02T04:00:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4982024-11-02T04:00:23.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992024-11-02T04:00:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5002024-11-02T04:00:23.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5012024-11-02T04:00:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5022024-11-02T04:00:23.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5032024-11-02T04:00:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5042024-11-02T04:00:23.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-11-02T04:00:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
5062024-11-02T04:00:23.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5072024-11-02T04:00:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5082024-11-02T04:00:23.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
5092024-11-02T04:00:23.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.259714ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
5102024-11-02T04:00:23.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5112024-11-02T04:00:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5122024-11-02T04:00:23.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.189718ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5132024-11-02T04:00:23.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43f7ba99-aa52-49d9-a041-25763f751b1c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5142024-11-02T04:00:23.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43f7ba99-aa52-49d9-a041-25763f751b1c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5152024-11-02T04:00:23.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43f7ba99-aa52-49d9-a041-25763f751b1c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5162024-11-02T04:00:23.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = b29a547c-5e7c-4ffc-9395-1d489f75f93c response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
5172024-11-02T04:00:24.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 967cf6c8-6760-4254-a56f-e352528a9f98 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5182024-11-02T04:00:24.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 967cf6c8-6760-4254-a56f-e352528a9f98 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5192024-11-02T04:00:24.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 967cf6c8-6760-4254-a56f-e352528a9f98 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5202024-11-02T04:00:25.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 74d18c4b-557b-4178-a090-e96689b5bcc6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5212024-11-02T04:00:25.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 74d18c4b-557b-4178-a090-e96689b5bcc6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5222024-11-02T04:00:25.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 74d18c4b-557b-4178-a090-e96689b5bcc6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5232024-11-02T04:00:26.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7bf36e8d-8d5b-4c0c-b404-ee276d5fd06e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5242024-11-02T04:00:26.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7bf36e8d-8d5b-4c0c-b404-ee276d5fd06e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5252024-11-02T04:00:26.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7bf36e8d-8d5b-4c0c-b404-ee276d5fd06e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5262024-11-02T04:00:27.392ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5272024-11-02T04:00:27.392ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
5282024-11-02T04:00:27.422ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5292024-11-02T04:00:27.422ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49074
5302024-11-02T04:00:27.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49074 req_id = ae052229-5507-4d14-89ba-6dc9638c8afb roles = RoleSet { roles: {} } uri = /metrics/producers
5312024-11-02T04:00:27.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49074 req_id = ae052229-5507-4d14-89ba-6dc9638c8afb resource = Database result = Ok(()) uri = /metrics/producers
5322024-11-02T04:00:27.458ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
5332024-11-02T04:00:27.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35403 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49074 req_id = ae052229-5507-4d14-89ba-6dc9638c8afb response_code = 201 uri = /metrics/producers
5342024-11-02T04:00:27.458ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ae052229-5507-4d14-89ba-6dc9638c8afb", "content-length": "41", "date": "Sat, 02 Nov 2024 04:00:26 GMT"} })
5352024-11-02T04:00:27.458ZDEBGnexus (producer-registration-task): registered with nexus successfully
5362024-11-02T04:00:27.458ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5372024-11-02T04:00:27.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d70c86f-3fe3-4717-818b-7e5bc441bfd7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5382024-11-02T04:00:27.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d70c86f-3fe3-4717-818b-7e5bc441bfd7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5392024-11-02T04:00:27.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d70c86f-3fe3-4717-818b-7e5bc441bfd7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5402024-11-02T04:00:28.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9286451b-1658-457c-bd70-2011f5ed8122 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5412024-11-02T04:00:28.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9286451b-1658-457c-bd70-2011f5ed8122 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5422024-11-02T04:00:28.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9286451b-1658-457c-bd70-2011f5ed8122 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5432024-11-02T04:00:29.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc2261e9-bb84-48b6-9ce1-410dc29c1c81 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5442024-11-02T04:00:29.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc2261e9-bb84-48b6-9ce1-410dc29c1c81 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5452024-11-02T04:00:29.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc2261e9-bb84-48b6-9ce1-410dc29c1c81 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5462024-11-02T04:00:30.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a4e812d-dd16-4b09-8115-9b8baf4abe8a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5472024-11-02T04:00:30.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a4e812d-dd16-4b09-8115-9b8baf4abe8a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5482024-11-02T04:00:30.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a4e812d-dd16-4b09-8115-9b8baf4abe8a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5492024-11-02T04:00:31.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45e47854-74c9-4832-878c-0fc2a9154f8c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5502024-11-02T04:00:31.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45e47854-74c9-4832-878c-0fc2a9154f8c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5512024-11-02T04:00:31.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45e47854-74c9-4832-878c-0fc2a9154f8c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5522024-11-02T04:00:32.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55de6c29-d784-44de-99a7-a059b9f7ad5b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5532024-11-02T04:00:32.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55de6c29-d784-44de-99a7-a059b9f7ad5b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5542024-11-02T04:00:32.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55de6c29-d784-44de-99a7-a059b9f7ad5b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5552024-11-02T04:00:33.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
5562024-11-02T04:00:33.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5572024-11-02T04:00:33.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
5582024-11-02T04:00:33.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5592024-11-02T04:00:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5602024-11-02T04:00:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5612024-11-02T04:00:33.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5622024-11-02T04:00:33.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-02T04:00:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5642024-11-02T04:00:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5652024-11-02T04:00:33.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5662024-11-02T04:00:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5672024-11-02T04:00:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5682024-11-02T04:00:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5692024-11-02T04:00:33.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702024-11-02T04:00:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
5712024-11-02T04:00:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5722024-11-02T04:00:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5732024-11-02T04:00:33.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.091826ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5742024-11-02T04:00:33.650ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
5752024-11-02T04:00:33.650ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.135147ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
5762024-11-02T04:00:33.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f789cee1-d291-499b-a8c7-757d43b8e414 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5772024-11-02T04:00:33.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f789cee1-d291-499b-a8c7-757d43b8e414 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5782024-11-02T04:00:33.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f789cee1-d291-499b-a8c7-757d43b8e414 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5792024-11-02T04:00:34.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34755de2-abdd-47dc-90a4-53c33496260e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5802024-11-02T04:00:34.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34755de2-abdd-47dc-90a4-53c33496260e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5812024-11-02T04:00:34.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34755de2-abdd-47dc-90a4-53c33496260e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5822024-11-02T04:00:36.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dabf114-0c5f-492b-81f3-21e08f3d66cf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5832024-11-02T04:00:36.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dabf114-0c5f-492b-81f3-21e08f3d66cf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5842024-11-02T04:00:36.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dabf114-0c5f-492b-81f3-21e08f3d66cf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5852024-11-02T04:00:37.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a356f1b4-5b3d-4f91-876c-62c5213fe68e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5862024-11-02T04:00:37.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a356f1b4-5b3d-4f91-876c-62c5213fe68e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5872024-11-02T04:00:37.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a356f1b4-5b3d-4f91-876c-62c5213fe68e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5882024-11-02T04:00:38.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c89032f2-79d1-48f5-a238-66be0a9752f8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5892024-11-02T04:00:38.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c89032f2-79d1-48f5-a238-66be0a9752f8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5902024-11-02T04:00:38.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c89032f2-79d1-48f5-a238-66be0a9752f8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5912024-11-02T04:00:38.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 22608098-d65a-497d-8994-5c6b047f78f2 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
5922024-11-02T04:00:39.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e63b7c7-1d3a-4b3d-8a21-b34659e91479 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5932024-11-02T04:00:39.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e63b7c7-1d3a-4b3d-8a21-b34659e91479 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5942024-11-02T04:00:39.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e63b7c7-1d3a-4b3d-8a21-b34659e91479 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5952024-11-02T04:00:40.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1ec34a7-61e6-407f-b4e7-98788f7d5b82 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5962024-11-02T04:00:40.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1ec34a7-61e6-407f-b4e7-98788f7d5b82 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5972024-11-02T04:00:40.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1ec34a7-61e6-407f-b4e7-98788f7d5b82 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5982024-11-02T04:00:41.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac0d87a9-9ef3-406b-9d04-68ad595bcec0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
5992024-11-02T04:00:41.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac0d87a9-9ef3-406b-9d04-68ad595bcec0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6002024-11-02T04:00:41.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac0d87a9-9ef3-406b-9d04-68ad595bcec0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6012024-11-02T04:00:42.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 185c58e7-dc1b-49a6-80cf-2ff54442b7e5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6022024-11-02T04:00:42.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 185c58e7-dc1b-49a6-80cf-2ff54442b7e5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6032024-11-02T04:00:42.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 185c58e7-dc1b-49a6-80cf-2ff54442b7e5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6042024-11-02T04:00:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555ca333-44bf-4fb5-a474-9d23cd676cc8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6052024-11-02T04:00:43.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555ca333-44bf-4fb5-a474-9d23cd676cc8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6062024-11-02T04:00:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555ca333-44bf-4fb5-a474-9d23cd676cc8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
6072024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
6082024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
6092024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6102024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6112024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
6122024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
6132024-11-02T04:00:43.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6142024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6152024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
6162024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6172024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
6182024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6192024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
6202024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
6212024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
6222024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6232024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6242024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6252024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6262024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
6272024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
6282024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6292024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
6302024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6312024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6322024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
6332024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6342024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
6352024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
6362024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.71\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
6372024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
6382024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.83\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
6392024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.791\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6402024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
6412024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.99\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6422024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6432024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6442024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6452024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6462024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6472024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6482024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6492024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6502024-11-02T04:00:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6512024-11-02T04:00:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6522024-11-02T04:00:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6532024-11-02T04:00:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6542024-11-02T04:00:43.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6552024-11-02T04:00:43.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562024-11-02T04:00:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.520445ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6572024-11-02T04:00:43.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6582024-11-02T04:00:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592024-11-02T04:00:43.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9547, tv_nsec: 522696102 } })
6602024-11-02T04:00:43.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
6612024-11-02T04:00:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6622024-11-02T04:00:43.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6632024-11-02T04:00:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6642024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6652024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6662024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6672024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6682024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6692024-11-02T04:00:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6702024-11-02T04:00:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6712024-11-02T04:00:43.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6722024-11-02T04:00:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6732024-11-02T04:00:43.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6742024-11-02T04:00:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6752024-11-02T04:00:43.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6762024-11-02T04:00:43.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9547, tv_nsec: 529361385 } })
6772024-11-02T04:00:43.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-11-02T04:00:43.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
6792024-11-02T04:00:43.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802024-11-02T04:00:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6812024-11-02T04:00:43.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6822024-11-02T04:00:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6832024-11-02T04:00:43.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9547, tv_nsec: 530762265 } })
6842024-11-02T04:00:43.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
6852024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6862024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6872024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6882024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6892024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6902024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6912024-11-02T04:00:43.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6922024-11-02T04:00:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6932024-11-02T04:00:43.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6942024-11-02T04:00:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6952024-11-02T04:00:43.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6962024-11-02T04:00:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6972024-11-02T04:00:43.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6982024-11-02T04:00:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6992024-11-02T04:00:43.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7002024-11-02T04:00:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7012024-11-02T04:00:43.582ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7022024-11-02T04:00:43.582ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7032024-11-02T04:00:43.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7042024-11-02T04:00:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7052024-11-02T04:00:43.586ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7062024-11-02T04:00:43.586ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7072024-11-02T04:00:43.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7082024-11-02T04:00:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7092024-11-02T04:00:43.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.495786ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7102024-11-02T04:00:43.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7112024-11-02T04:00:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7122024-11-02T04:00:43.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7132024-11-02T04:00:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7142024-11-02T04:00:43.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-11-02T04:00:43.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7162024-11-02T04:00:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7172024-11-02T04:00:43.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-11-02T04:00:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
7192024-11-02T04:00:43.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7202024-11-02T04:00:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7212024-11-02T04:00:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
7222024-11-02T04:00:43.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7232024-11-02T04:00:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7242024-11-02T04:00:43.601ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.55188ms iteration = 8 status = 0
7252024-11-02T04:00:43.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
7262024-11-02T04:00:43.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.353845ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
7272024-11-02T04:00:43.609ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7282024-11-02T04:00:43.609ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.88732ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7292024-11-02T04:00:43.619ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7302024-11-02T04:00:43.619ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7312024-11-02T04:00:43.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 78.934195ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7322024-11-02T04:00:43.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.195264ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7332024-11-02T04:00:43.632ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7342024-11-02T04:00:43.632ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7352024-11-02T04:00:43.632ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb41fef6-fe70-42e3-8d5e-a19cf95a4465", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7362024-11-02T04:00:43.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7372024-11-02T04:00:43.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7382024-11-02T04:00:43.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7392024-11-02T04:00:43.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7402024-11-02T04:00:43.669ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.42019ms iteration = 11 status = {"physical_disks_added":0}
7412024-11-02T04:00:43.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7422024-11-02T04:00:43.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7432024-11-02T04:00:43.751ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7442024-11-02T04:00:43.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ad38205-fbb0-4256-b9e3-700ae83b4751", "content-length": "1", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7452024-11-02T04:00:43.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7462024-11-02T04:00:43.752ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7472024-11-02T04:00:43.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7482024-11-02T04:00:43.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7492024-11-02T04:00:43.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7502024-11-02T04:00:43.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7512024-11-02T04:00:43.755ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.232032ms iteration = 8 status = null
7522024-11-02T04:00:43.757ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7532024-11-02T04:00:43.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7542024-11-02T04:00:43.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7552024-11-02T04:00:43.759ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7562024-11-02T04:00:43.759ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0792606a-1a3c-48b3-a987-2b57f880c174", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7572024-11-02T04:00:43.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7582024-11-02T04:00:43.760ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7592024-11-02T04:00:43.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
7602024-11-02T04:00:43.761ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7612024-11-02T04:00:43.761ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "467c4cf4-f121-4de0-8a7c-20c8461807ca", "content-length": "26", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7622024-11-02T04:00:43.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7632024-11-02T04:00:43.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
7642024-11-02T04:00:43.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7652024-11-02T04:00:43.788ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7662024-11-02T04:00:43.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7672024-11-02T04:00:43.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7682024-11-02T04:00:43.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 286.573594ms iteration = 8 status = {}
7692024-11-02T04:00:43.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9194b1d-43f5-475e-b0bd-bff986245690", "content-length": "372", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7702024-11-02T04:00:43.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712024-11-02T04:00:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722024-11-02T04:00:43.891ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7732024-11-02T04:00:43.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7742024-11-02T04:00:43.891ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "014351af-8715-4211-b91f-a086f1e2355a", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7752024-11-02T04:00:43.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7762024-11-02T04:00:43.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7772024-11-02T04:00:43.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7782024-11-02T04:00:43.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7792024-11-02T04:00:43.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = f3028f45-1a1a-4e52-a452-2bfe67e7344b roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
7802024-11-02T04:00:43.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7812024-11-02T04:00:43.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = f3028f45-1a1a-4e52-a452-2bfe67e7344b resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
7822024-11-02T04:00:43.907ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a037fc-4198-4b1e-9aea-735256f4fac4", "content-length": "691", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7832024-11-02T04:00:43.907ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7842024-11-02T04:00:43.907ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7852024-11-02T04:00:43.907ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7862024-11-02T04:00:43.908ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.368622ms iteration = 8 status = {}
7872024-11-02T04:00:43.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = f3028f45-1a1a-4e52-a452-2bfe67e7344b response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
7882024-11-02T04:00:43.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7892024-11-02T04:00:43.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3a0e4fe7-126f-4cab-a698-e6d0fe207a70 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
7902024-11-02T04:00:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7912024-11-02T04:00:43.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3a0e4fe7-126f-4cab-a698-e6d0fe207a70 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
7922024-11-02T04:00:43.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3a0e4fe7-126f-4cab-a698-e6d0fe207a70 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
7932024-11-02T04:00:43.912ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7942024-11-02T04:00:43.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7952024-11-02T04:00:43.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a41b25e5-b120-4523-af28-037db63d2b16", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
7962024-11-02T04:00:43.914ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.259057ms iteration = 9 status = {}
7972024-11-02T04:00:43.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7982024-11-02T04:00:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7992024-11-02T04:00:43.917ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
8002024-11-02T04:00:43.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8012024-11-02T04:00:43.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8022024-11-02T04:00:43.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8032024-11-02T04:00:43.927ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "513493b3-5db9-410a-a060-8896a03ca3cb", "content-length": "134", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
8042024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8052024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
8062024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8072024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8082024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8092024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8102024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8112024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8122024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8132024-11-02T04:00:43.927ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8142024-11-02T04:00:43.928ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
8152024-11-02T04:00:43.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8162024-11-02T04:00:43.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8172024-11-02T04:00:43.930ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8182024-11-02T04:00:43.930ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbc39118-fa31-4f0e-b19d-07179317f9a6", "content-length": "2", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
8192024-11-02T04:00:43.930ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8202024-11-02T04:00:43.930ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6dc4e42-11a4-4a04-bab4-f61b6ddf2730", "content-length": "52", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
8212024-11-02T04:00:43.930ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
8222024-11-02T04:00:43.930ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8232024-11-02T04:00:43.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b34ad5dd-5301-4eef-960f-17a8c4941853 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8242024-11-02T04:00:43.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b34ad5dd-5301-4eef-960f-17a8c4941853 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8252024-11-02T04:00:43.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b34ad5dd-5301-4eef-960f-17a8c4941853 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8262024-11-02T04:00:44.026ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9e382a05-e839-4ea1-bc47-aa01d952a3ff", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
8272024-11-02T04:00:44.026ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
8282024-11-02T04:00:44.026ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8292024-11-02T04:00:44.026ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef8f96e7-0e05-4d7d-91a3-39c5ce079ce5", "content-length": "682", "date": "Sat, 02 Nov 2024 04:00:43 GMT"} })
8302024-11-02T04:00:44.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-11-02T04:00:44.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-11-02T04:00:44.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8332024-11-02T04:00:44.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8342024-11-02T04:00:44.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352024-11-02T04:00:44.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362024-11-02T04:00:44.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8372024-11-02T04:00:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8382024-11-02T04:00:44.043ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 503.115555ms iteration = 8 status = {}
8392024-11-02T04:00:44.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3502393b-b2c9-434a-be76-823336042190 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8402024-11-02T04:00:44.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3502393b-b2c9-434a-be76-823336042190 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8412024-11-02T04:00:44.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3502393b-b2c9-434a-be76-823336042190 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8422024-11-02T04:00:45.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e78c6f91-88f7-41c8-ab06-21934bba0619 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8432024-11-02T04:00:45.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e78c6f91-88f7-41c8-ab06-21934bba0619 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8442024-11-02T04:00:45.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e78c6f91-88f7-41c8-ab06-21934bba0619 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8452024-11-02T04:00:46.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d0b56edd-2cd9-416f-b7c7-f7ac35219781 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8462024-11-02T04:00:46.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d0b56edd-2cd9-416f-b7c7-f7ac35219781 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8472024-11-02T04:00:46.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d0b56edd-2cd9-416f-b7c7-f7ac35219781 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8482024-11-02T04:00:47.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad7888d3-5aa6-4e34-8cd2-e4b11c899447 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8492024-11-02T04:00:47.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad7888d3-5aa6-4e34-8cd2-e4b11c899447 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8502024-11-02T04:00:47.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad7888d3-5aa6-4e34-8cd2-e4b11c899447 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8512024-11-02T04:00:48.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78311f82-e495-46fe-89bb-a3de22b4d796 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8522024-11-02T04:00:48.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78311f82-e495-46fe-89bb-a3de22b4d796 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8532024-11-02T04:00:48.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78311f82-e495-46fe-89bb-a3de22b4d796 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8542024-11-02T04:00:49.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41a15e99-fa32-4996-9347-83e455fa1991 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8552024-11-02T04:00:49.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41a15e99-fa32-4996-9347-83e455fa1991 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8562024-11-02T04:00:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41a15e99-fa32-4996-9347-83e455fa1991 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8572024-11-02T04:00:50.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a073043-5bbb-4125-ba89-9b902596d9b0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8582024-11-02T04:00:50.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a073043-5bbb-4125-ba89-9b902596d9b0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8592024-11-02T04:00:50.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a073043-5bbb-4125-ba89-9b902596d9b0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8602024-11-02T04:00:51.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 033f4558-1fca-43a5-91f0-5575b9b75959 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8612024-11-02T04:00:51.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 033f4558-1fca-43a5-91f0-5575b9b75959 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8622024-11-02T04:00:51.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 033f4558-1fca-43a5-91f0-5575b9b75959 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8632024-11-02T04:00:52.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bc5eaa-ecb8-458f-944d-700b330da6af roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8642024-11-02T04:00:52.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bc5eaa-ecb8-458f-944d-700b330da6af resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8652024-11-02T04:00:52.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bc5eaa-ecb8-458f-944d-700b330da6af response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8662024-11-02T04:00:53.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b424398-924f-4e86-91e4-3399f0bfa486 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8672024-11-02T04:00:53.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b424398-924f-4e86-91e4-3399f0bfa486 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8682024-11-02T04:00:53.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b424398-924f-4e86-91e4-3399f0bfa486 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8692024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
8702024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
8712024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8722024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8732024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8742024-11-02T04:00:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8752024-11-02T04:00:53.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8762024-11-02T04:00:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8772024-11-02T04:00:53.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8782024-11-02T04:00:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8792024-11-02T04:00:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8802024-11-02T04:00:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8812024-11-02T04:00:53.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-11-02T04:00:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8832024-11-02T04:00:53.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8842024-11-02T04:00:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
8852024-11-02T04:00:53.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8862024-11-02T04:00:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8872024-11-02T04:00:53.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.102606ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8882024-11-02T04:00:53.698ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
8892024-11-02T04:00:53.698ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 158.042354ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
8902024-11-02T04:00:53.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1466 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 4f8bae93-be23-4c86-bfbe-35aea53a655a response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
8912024-11-02T04:00:54.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40be828d-320d-404b-92b8-79b2b24bd10e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8922024-11-02T04:00:54.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40be828d-320d-404b-92b8-79b2b24bd10e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8932024-11-02T04:00:54.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40be828d-320d-404b-92b8-79b2b24bd10e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8942024-11-02T04:00:55.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3fa42696-04ec-438b-be05-ef8e0e757572 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8952024-11-02T04:00:55.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3fa42696-04ec-438b-be05-ef8e0e757572 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8962024-11-02T04:00:55.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3fa42696-04ec-438b-be05-ef8e0e757572 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8972024-11-02T04:00:56.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a3c9a85-329c-41aa-b5ac-1cd893027197 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8982024-11-02T04:00:56.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a3c9a85-329c-41aa-b5ac-1cd893027197 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
8992024-11-02T04:00:56.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a3c9a85-329c-41aa-b5ac-1cd893027197 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9002024-11-02T04:00:57.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af011ed5-5951-4a11-9fc7-52bdb57b21a7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9012024-11-02T04:00:57.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af011ed5-5951-4a11-9fc7-52bdb57b21a7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9022024-11-02T04:00:57.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af011ed5-5951-4a11-9fc7-52bdb57b21a7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9032024-11-02T04:00:58.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d50624-bd6f-4c87-bb72-3919db45fa3c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9042024-11-02T04:00:58.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d50624-bd6f-4c87-bb72-3919db45fa3c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9052024-11-02T04:00:58.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d50624-bd6f-4c87-bb72-3919db45fa3c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9062024-11-02T04:00:59.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 62013f02-319e-44bd-b0ca-95e021c73d43 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9072024-11-02T04:00:59.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 62013f02-319e-44bd-b0ca-95e021c73d43 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9082024-11-02T04:00:59.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 62013f02-319e-44bd-b0ca-95e021c73d43 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9092024-11-02T04:01:00.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db35a8f4-788a-4f20-ab62-054b9a9eac11 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9102024-11-02T04:01:00.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db35a8f4-788a-4f20-ab62-054b9a9eac11 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9112024-11-02T04:01:00.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db35a8f4-788a-4f20-ab62-054b9a9eac11 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9122024-11-02T04:01:01.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb0435ea-3ebb-4ae3-b806-3538f717ea46 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9132024-11-02T04:01:01.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb0435ea-3ebb-4ae3-b806-3538f717ea46 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9142024-11-02T04:01:01.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb0435ea-3ebb-4ae3-b806-3538f717ea46 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9152024-11-02T04:01:02.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9ac2fee6-4c6f-44e0-b78e-4bc155a01807 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9162024-11-02T04:01:02.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9ac2fee6-4c6f-44e0-b78e-4bc155a01807 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9172024-11-02T04:01:02.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9ac2fee6-4c6f-44e0-b78e-4bc155a01807 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9182024-11-02T04:01:03.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
9192024-11-02T04:01:03.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9202024-11-02T04:01:03.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
9212024-11-02T04:01:03.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9222024-11-02T04:01:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9232024-11-02T04:01:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9242024-11-02T04:01:03.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9252024-11-02T04:01:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9262024-11-02T04:01:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272024-11-02T04:01:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9282024-11-02T04:01:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9292024-11-02T04:01:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9302024-11-02T04:01:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9312024-11-02T04:01:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9322024-11-02T04:01:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9332024-11-02T04:01:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
9342024-11-02T04:01:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9352024-11-02T04:01:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9362024-11-02T04:01:03.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
9372024-11-02T04:01:03.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.213393ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
9382024-11-02T04:01:03.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.382402ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9392024-11-02T04:01:03.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61ea432e-1de1-416b-bd9e-931b148bf32c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9402024-11-02T04:01:03.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61ea432e-1de1-416b-bd9e-931b148bf32c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9412024-11-02T04:01:03.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61ea432e-1de1-416b-bd9e-931b148bf32c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9422024-11-02T04:01:04.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 498ccd10-9c81-44b7-bf73-75f04c9e0b19 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9432024-11-02T04:01:04.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 498ccd10-9c81-44b7-bf73-75f04c9e0b19 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9442024-11-02T04:01:04.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 498ccd10-9c81-44b7-bf73-75f04c9e0b19 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9452024-11-02T04:01:05.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67f0f85e-ff00-4ad0-871c-52f5f65ce118 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9462024-11-02T04:01:05.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67f0f85e-ff00-4ad0-871c-52f5f65ce118 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9472024-11-02T04:01:05.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67f0f85e-ff00-4ad0-871c-52f5f65ce118 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9482024-11-02T04:01:06.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49dc75e7-ba67-41fb-b143-10f009fb5dbd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9492024-11-02T04:01:06.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49dc75e7-ba67-41fb-b143-10f009fb5dbd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9502024-11-02T04:01:06.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49dc75e7-ba67-41fb-b143-10f009fb5dbd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9512024-11-02T04:01:07.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 60679b46-dd0a-46ba-a11e-98819f3325b4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9522024-11-02T04:01:07.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 60679b46-dd0a-46ba-a11e-98819f3325b4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9532024-11-02T04:01:07.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 60679b46-dd0a-46ba-a11e-98819f3325b4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9542024-11-02T04:01:08.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d94b04d-d2ee-4b9e-a524-33e8a22bec8b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9552024-11-02T04:01:08.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d94b04d-d2ee-4b9e-a524-33e8a22bec8b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9562024-11-02T04:01:08.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d94b04d-d2ee-4b9e-a524-33e8a22bec8b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9572024-11-02T04:01:08.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 29bc7798-56fa-4276-8130-e9ea5e06cfab response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
9582024-11-02T04:01:09.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a28942c8-c46e-4f1b-9f85-8794585eb0e1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9592024-11-02T04:01:09.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a28942c8-c46e-4f1b-9f85-8794585eb0e1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9602024-11-02T04:01:09.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a28942c8-c46e-4f1b-9f85-8794585eb0e1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9612024-11-02T04:01:10.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7f7f925-6050-40e9-94ba-2f8592fed2cf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9622024-11-02T04:01:10.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7f7f925-6050-40e9-94ba-2f8592fed2cf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9632024-11-02T04:01:10.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7f7f925-6050-40e9-94ba-2f8592fed2cf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9642024-11-02T04:01:11.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 842350e5-a1e5-40d9-be2e-c0f2cb6e2031 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9652024-11-02T04:01:11.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 842350e5-a1e5-40d9-be2e-c0f2cb6e2031 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9662024-11-02T04:01:11.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 842350e5-a1e5-40d9-be2e-c0f2cb6e2031 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9672024-11-02T04:01:12.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56c748e-b814-40fa-b84a-1fda8683fc9b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9682024-11-02T04:01:12.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56c748e-b814-40fa-b84a-1fda8683fc9b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9692024-11-02T04:01:12.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56c748e-b814-40fa-b84a-1fda8683fc9b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
9702024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
9712024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
9722024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
9732024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
9742024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9752024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
9762024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9772024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9782024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
9792024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
9802024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9812024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9822024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9832024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
9842024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
9852024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
9862024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9872024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9882024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
9892024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
9902024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9912024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
9922024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
9932024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9942024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9952024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
9962024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
9972024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9982024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9992024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
10002024-11-02T04:01:13.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
10012024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.62\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
10022024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
10032024-11-02T04:01:13.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:51:13.540912626 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10042024-11-02T04:01:13.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
10052024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10062024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
10072024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
10082024-11-02T04:01:13.541ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10092024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10102024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10112024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10122024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
10132024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.33\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10142024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
10152024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10162024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
10172024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.15\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
10182024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
10192024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
10202024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10212024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10222024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
10232024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.74\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
10242024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
10252024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
10262024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10272024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
10282024-11-02T04:01:13.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10292024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.94\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10302024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
10312024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10322024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10332024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10342024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10352024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10362024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10372024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10382024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10392024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10402024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10412024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10422024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10432024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10442024-11-02T04:01:13.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9577, tv_nsec: 519594585 } })
10452024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10462024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10472024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10482024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10492024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10502024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10512024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10522024-11-02T04:01:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10532024-11-02T04:01:13.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9577, tv_nsec: 519779869 } })
10542024-11-02T04:01:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10552024-11-02T04:01:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.236807ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10562024-11-02T04:01:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10572024-11-02T04:01:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.199195ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10582024-11-02T04:01:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10592024-11-02T04:01:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10602024-11-02T04:01:13.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10612024-11-02T04:01:13.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10622024-11-02T04:01:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.744292ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10632024-11-02T04:01:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10642024-11-02T04:01:13.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-11-02T04:01:13.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10662024-11-02T04:01:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10672024-11-02T04:01:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10682024-11-02T04:01:13.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10692024-11-02T04:01:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10702024-11-02T04:01:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10712024-11-02T04:01:13.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10722024-11-02T04:01:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10732024-11-02T04:01:13.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10742024-11-02T04:01:13.552ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:51:13.540912626 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10752024-11-02T04:01:13.552ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.106118ms iteration = 5 status = {"expiration":"2024-11-02T03:51:13.540912626Z","pruned":[]}
10762024-11-02T04:01:13.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9577, tv_nsec: 530348626 } })
10772024-11-02T04:01:13.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
10782024-11-02T04:01:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10792024-11-02T04:01:13.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10802024-11-02T04:01:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10812024-11-02T04:01:13.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10822024-11-02T04:01:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10832024-11-02T04:01:13.557ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.960715ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
10842024-11-02T04:01:13.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9577, tv_nsec: 536519629 } })
10852024-11-02T04:01:13.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10862024-11-02T04:01:13.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10872024-11-02T04:01:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10882024-11-02T04:01:13.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9577, tv_nsec: 539821289 } })
10892024-11-02T04:01:13.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
10902024-11-02T04:01:13.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10912024-11-02T04:01:13.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10922024-11-02T04:01:13.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10932024-11-02T04:01:13.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10942024-11-02T04:01:13.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10952024-11-02T04:01:13.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10962024-11-02T04:01:13.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10972024-11-02T04:01:13.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10982024-11-02T04:01:13.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10992024-11-02T04:01:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11002024-11-02T04:01:13.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11012024-11-02T04:01:13.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11022024-11-02T04:01:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11032024-11-02T04:01:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11042024-11-02T04:01:13.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052024-11-02T04:01:13.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-11-02T04:01:13.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11072024-11-02T04:01:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11082024-11-02T04:01:13.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11092024-11-02T04:01:13.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11102024-11-02T04:01:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11112024-11-02T04:01:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122024-11-02T04:01:13.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132024-11-02T04:01:13.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11142024-11-02T04:01:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11152024-11-02T04:01:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11162024-11-02T04:01:13.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11172024-11-02T04:01:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11182024-11-02T04:01:13.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192024-11-02T04:01:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11202024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11212024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11222024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11232024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11242024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11252024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11262024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11272024-11-02T04:01:13.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11282024-11-02T04:01:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11292024-11-02T04:01:13.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.511831ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11302024-11-02T04:01:13.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312024-11-02T04:01:13.616ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11322024-11-02T04:01:13.616ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11332024-11-02T04:01:13.616ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.888ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11342024-11-02T04:01:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11352024-11-02T04:01:13.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11362024-11-02T04:01:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11372024-11-02T04:01:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11382024-11-02T04:01:13.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11392024-11-02T04:01:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11402024-11-02T04:01:13.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-11-02T04:01:13.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11422024-11-02T04:01:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11432024-11-02T04:01:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
11442024-11-02T04:01:13.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452024-11-02T04:01:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462024-11-02T04:01:13.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11472024-11-02T04:01:13.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11482024-11-02T04:01:13.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11492024-11-02T04:01:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11502024-11-02T04:01:13.628ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.521279ms iteration = 9 status = 0
11512024-11-02T04:01:13.640ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11522024-11-02T04:01:13.640ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11532024-11-02T04:01:13.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11542024-11-02T04:01:13.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11552024-11-02T04:01:13.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11562024-11-02T04:01:13.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11572024-11-02T04:01:13.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11582024-11-02T04:01:13.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11592024-11-02T04:01:13.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11602024-11-02T04:01:13.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11612024-11-02T04:01:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11622024-11-02T04:01:13.655ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11632024-11-02T04:01:13.655ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11642024-11-02T04:01:13.655ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11652024-11-02T04:01:13.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11662024-11-02T04:01:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11672024-11-02T04:01:13.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682024-11-02T04:01:13.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.679119ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11692024-11-02T04:01:13.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11702024-11-02T04:01:13.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11712024-11-02T04:01:13.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11722024-11-02T04:01:13.672ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11732024-11-02T04:01:13.672ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11742024-11-02T04:01:13.672ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 131.122896ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11752024-11-02T04:01:13.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11762024-11-02T04:01:13.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11772024-11-02T04:01:13.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782024-11-02T04:01:13.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792024-11-02T04:01:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
11802024-11-02T04:01:13.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11812024-11-02T04:01:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11822024-11-02T04:01:13.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11832024-11-02T04:01:13.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11842024-11-02T04:01:13.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11852024-11-02T04:01:13.683ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11862024-11-02T04:01:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.101871ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11872024-11-02T04:01:13.689ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11882024-11-02T04:01:13.689ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11892024-11-02T04:01:13.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.232263ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11902024-11-02T04:01:13.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
11912024-11-02T04:01:13.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 151.486193ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
11922024-11-02T04:01:13.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-11-02T04:01:13.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11942024-11-02T04:01:13.697ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11952024-11-02T04:01:13.697ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a85d31c9-d2f8-40f0-9825-deada3f0af2d", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
11962024-11-02T04:01:13.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11972024-11-02T04:01:13.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11982024-11-02T04:01:13.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11992024-11-02T04:01:13.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12002024-11-02T04:01:13.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12012024-11-02T04:01:13.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12022024-11-02T04:01:13.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12032024-11-02T04:01:13.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-11-02T04:01:13.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12052024-11-02T04:01:13.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12062024-11-02T04:01:13.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12072024-11-02T04:01:13.708ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12082024-11-02T04:01:13.710ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12092024-11-02T04:01:13.710ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
12102024-11-02T04:01:13.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12112024-11-02T04:01:13.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12122024-11-02T04:01:13.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-11-02T04:01:13.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12142024-11-02T04:01:13.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12152024-11-02T04:01:13.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12162024-11-02T04:01:13.736ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12172024-11-02T04:01:13.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 195.519759ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12182024-11-02T04:01:13.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12192024-11-02T04:01:13.737ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12202024-11-02T04:01:13.737ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "709b06e8-a8cb-43db-93b4-ad298ef6ca81", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12212024-11-02T04:01:13.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12222024-11-02T04:01:13.737ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
12232024-11-02T04:01:13.737ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.117313ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12242024-11-02T04:01:13.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12252024-11-02T04:01:13.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12262024-11-02T04:01:13.740ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12272024-11-02T04:01:13.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12282024-11-02T04:01:13.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12292024-11-02T04:01:13.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12302024-11-02T04:01:13.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12312024-11-02T04:01:13.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12322024-11-02T04:01:13.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12332024-11-02T04:01:13.746ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.300279ms iteration = 12 status = {"physical_disks_added":0}
12342024-11-02T04:01:13.776ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12352024-11-02T04:01:13.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 493054c4-464d-4619-9a0e-cdcf4b2bff7d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
12362024-11-02T04:01:13.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 493054c4-464d-4619-9a0e-cdcf4b2bff7d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
12372024-11-02T04:01:13.868ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12382024-11-02T04:01:13.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12392024-11-02T04:01:13.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7c02dd8-0ea5-4b22-8751-5b97b7733e49", "content-length": "372", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12402024-11-02T04:01:13.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12412024-11-02T04:01:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12422024-11-02T04:01:13.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12432024-11-02T04:01:13.870ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
12442024-11-02T04:01:13.870ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12452024-11-02T04:01:13.870ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
12462024-11-02T04:01:13.871ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 330.216372ms iteration = 6 status = {"generation":2}
12472024-11-02T04:01:13.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 493054c4-464d-4619-9a0e-cdcf4b2bff7d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
12482024-11-02T04:01:13.873ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.251476ms iteration = 9 status = {}
12492024-11-02T04:01:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12502024-11-02T04:01:13.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12512024-11-02T04:01:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12522024-11-02T04:01:13.876ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12532024-11-02T04:01:13.876ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12542024-11-02T04:01:13.876ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
12552024-11-02T04:01:13.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 335.467074ms iteration = 6 status = {"generation":1}
12562024-11-02T04:01:13.888ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12572024-11-02T04:01:13.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dbfee537-aa85-438e-9505-8adfadb8e9e2", "date": "Sat, 02 Nov 2024 04:01:12 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
12582024-11-02T04:01:13.889ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
12592024-11-02T04:01:13.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4131f2c6-a1b2-4caf-b918-1f2efa9e92d9", "date": "Sat, 02 Nov 2024 04:01:12 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
12602024-11-02T04:01:13.891ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
12612024-11-02T04:01:13.893ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
12622024-11-02T04:01:13.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 352.52404ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
12632024-11-02T04:01:13.916ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12642024-11-02T04:01:13.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12652024-11-02T04:01:13.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4dc4c9e4-bfef-42a9-aeeb-a1c4cd19a55b", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12662024-11-02T04:01:13.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12672024-11-02T04:01:13.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12682024-11-02T04:01:13.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12692024-11-02T04:01:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12702024-11-02T04:01:13.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12712024-11-02T04:01:13.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12722024-11-02T04:01:13.925ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12732024-11-02T04:01:13.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12742024-11-02T04:01:13.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "04013604-d601-4964-8170-5f745e17120e", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12752024-11-02T04:01:13.927ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.766647ms iteration = 10 status = {}
12762024-11-02T04:01:13.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
12772024-11-02T04:01:13.931ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12782024-11-02T04:01:13.931ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a3d9ffc-d8da-419c-a3d7-b55286ed70aa", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12792024-11-02T04:01:13.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12802024-11-02T04:01:13.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
12812024-11-02T04:01:13.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 15925d61-69ab-46cb-9a79-313f4bce912a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12822024-11-02T04:01:13.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 15925d61-69ab-46cb-9a79-313f4bce912a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12832024-11-02T04:01:13.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12842024-11-02T04:01:13.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1514c59f-aabd-453f-b6eb-b2099aef51b9", "content-length": "691", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
12852024-11-02T04:01:13.992ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12862024-11-02T04:01:13.992ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12872024-11-02T04:01:13.992ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12882024-11-02T04:01:13.993ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.791895ms iteration = 9 status = {}
12892024-11-02T04:01:13.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 15925d61-69ab-46cb-9a79-313f4bce912a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12902024-11-02T04:01:14.048ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12912024-11-02T04:01:14.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fd25700-8b2e-4d98-b3d7-fcd39eb899f2", "content-length": "1", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} })
12922024-11-02T04:01:14.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12932024-11-02T04:01:14.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12942024-11-02T04:01:14.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 512.872844ms iteration = 9 status = null
12952024-11-02T04:01:14.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12962024-11-02T04:01:14.116ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12972024-11-02T04:01:14.116ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d974a22b-14d0-4253-9131-5c6784d48d4b", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12982024-11-02T04:01:14.116ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12992024-11-02T04:01:14.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9f966e9a-d410-4143-a488-f42a612562cc", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13002024-11-02T04:01:14.118ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13012024-11-02T04:01:14.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8c711c6c-24d6-4fb0-9720-c904a9f665a1", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13022024-11-02T04:01:14.119ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13032024-11-02T04:01:14.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13042024-11-02T04:01:14.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.673391ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13052024-11-02T04:01:14.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13062024-11-02T04:01:14.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13072024-11-02T04:01:14.144ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
13082024-11-02T04:01:14.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13092024-11-02T04:01:14.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13102024-11-02T04:01:14.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13112024-11-02T04:01:14.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce807fb-26c5-4cfe-8972-4d8508dc59e1", "content-length": "134", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} })
13122024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13132024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
13142024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13152024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13162024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13172024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13182024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13192024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13202024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13212024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13222024-11-02T04:01:14.154ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
13232024-11-02T04:01:14.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13242024-11-02T04:01:14.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13252024-11-02T04:01:14.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13262024-11-02T04:01:14.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5205437-92fb-46c6-b3b0-9ac054ed4ccf", "content-length": "2", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} })
13272024-11-02T04:01:14.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13282024-11-02T04:01:14.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b9f4bc-0e7e-43fa-81f6-620335d11638", "content-length": "52", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} })
13292024-11-02T04:01:14.156ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
13302024-11-02T04:01:14.156ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13312024-11-02T04:01:14.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ddcad61c-0cf8-4400-8ecb-0d944e39437f", "date": "Sat, 02 Nov 2024 04:01:13 GMT"} })
13322024-11-02T04:01:14.264ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
13332024-11-02T04:01:14.264ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13342024-11-02T04:01:14.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cc792ce-d361-4005-94d6-92297f209616", "content-length": "682", "date": "Sat, 02 Nov 2024 04:01:14 GMT"} })
13352024-11-02T04:01:14.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13362024-11-02T04:01:14.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13372024-11-02T04:01:14.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13382024-11-02T04:01:14.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13392024-11-02T04:01:14.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13402024-11-02T04:01:14.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13412024-11-02T04:01:14.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13422024-11-02T04:01:14.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13432024-11-02T04:01:14.282ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.260389ms iteration = 9 status = {}
13442024-11-02T04:01:14.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 677896bc-494e-458b-9266-21e182b66780 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13452024-11-02T04:01:14.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 677896bc-494e-458b-9266-21e182b66780 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13462024-11-02T04:01:14.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 677896bc-494e-458b-9266-21e182b66780 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13472024-11-02T04:01:15.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3e7836b-aa00-4b92-8d76-c9bb0ca84256 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13482024-11-02T04:01:15.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3e7836b-aa00-4b92-8d76-c9bb0ca84256 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13492024-11-02T04:01:15.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f3e7836b-aa00-4b92-8d76-c9bb0ca84256 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13502024-11-02T04:01:16.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b31fa4a-6fee-4367-96ff-5942420dfe79 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13512024-11-02T04:01:16.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b31fa4a-6fee-4367-96ff-5942420dfe79 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13522024-11-02T04:01:16.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b31fa4a-6fee-4367-96ff-5942420dfe79 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13532024-11-02T04:01:17.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58c495bc-374d-4a2d-ade9-c67e7c1d61f7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13542024-11-02T04:01:17.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58c495bc-374d-4a2d-ade9-c67e7c1d61f7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13552024-11-02T04:01:17.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58c495bc-374d-4a2d-ade9-c67e7c1d61f7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13562024-11-02T04:01:18.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be7f68ed-b64e-4e48-83b5-c3ef363a98a3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13572024-11-02T04:01:18.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be7f68ed-b64e-4e48-83b5-c3ef363a98a3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13582024-11-02T04:01:18.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be7f68ed-b64e-4e48-83b5-c3ef363a98a3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13592024-11-02T04:01:20.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffb3fbfe-d321-43f5-83c8-10417e27534d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13602024-11-02T04:01:20.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffb3fbfe-d321-43f5-83c8-10417e27534d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13612024-11-02T04:01:20.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffb3fbfe-d321-43f5-83c8-10417e27534d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13622024-11-02T04:01:21.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58063145-0120-43ee-8d0a-4f3098e8166e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13632024-11-02T04:01:21.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58063145-0120-43ee-8d0a-4f3098e8166e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13642024-11-02T04:01:21.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 58063145-0120-43ee-8d0a-4f3098e8166e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13652024-11-02T04:01:22.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 449ce5cc-ed1f-4091-b563-a343339fa68c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13662024-11-02T04:01:22.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 449ce5cc-ed1f-4091-b563-a343339fa68c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13672024-11-02T04:01:22.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 449ce5cc-ed1f-4091-b563-a343339fa68c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13682024-11-02T04:01:23.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 626ef5bf-a1de-4c7d-bf55-01067a79b5ef roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13692024-11-02T04:01:23.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 626ef5bf-a1de-4c7d-bf55-01067a79b5ef resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13702024-11-02T04:01:23.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 626ef5bf-a1de-4c7d-bf55-01067a79b5ef response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13712024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
13722024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13732024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
13742024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13752024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13762024-11-02T04:01:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13772024-11-02T04:01:23.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13782024-11-02T04:01:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13792024-11-02T04:01:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13802024-11-02T04:01:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13812024-11-02T04:01:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13822024-11-02T04:01:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13832024-11-02T04:01:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13842024-11-02T04:01:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
13852024-11-02T04:01:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13862024-11-02T04:01:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13872024-11-02T04:01:23.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
13882024-11-02T04:01:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.218969ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
13892024-11-02T04:01:23.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13902024-11-02T04:01:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13912024-11-02T04:01:23.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.829925ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13922024-11-02T04:01:23.926ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 7550db4a-3717-485c-9d3e-84207d323c1f response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
13932024-11-02T04:01:24.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7cfa5ce9-771a-48ba-a458-25272ec53d68 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13942024-11-02T04:01:24.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7cfa5ce9-771a-48ba-a458-25272ec53d68 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13952024-11-02T04:01:24.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7cfa5ce9-771a-48ba-a458-25272ec53d68 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13962024-11-02T04:01:25.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b41e8b59-6844-4373-848a-2666206ee747 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13972024-11-02T04:01:25.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b41e8b59-6844-4373-848a-2666206ee747 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13982024-11-02T04:01:25.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b41e8b59-6844-4373-848a-2666206ee747 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
13992024-11-02T04:01:26.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9707174-c2c2-40a9-be11-a8d45547fee1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14002024-11-02T04:01:26.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9707174-c2c2-40a9-be11-a8d45547fee1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14012024-11-02T04:01:26.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9707174-c2c2-40a9-be11-a8d45547fee1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14022024-11-02T04:01:27.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85c05397-f8a2-46cd-962e-84792304e800 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14032024-11-02T04:01:27.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85c05397-f8a2-46cd-962e-84792304e800 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14042024-11-02T04:01:27.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85c05397-f8a2-46cd-962e-84792304e800 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14052024-11-02T04:01:28.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca19a0f2-cab1-4dc6-84e3-c834728c8719 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14062024-11-02T04:01:28.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca19a0f2-cab1-4dc6-84e3-c834728c8719 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14072024-11-02T04:01:28.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca19a0f2-cab1-4dc6-84e3-c834728c8719 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14082024-11-02T04:01:28.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3983204e-94ea-4c2c-bc9a-b595d3d69552 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
14092024-11-02T04:01:28.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3983204e-94ea-4c2c-bc9a-b595d3d69552 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
14102024-11-02T04:01:28.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 3983204e-94ea-4c2c-bc9a-b595d3d69552 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
14112024-11-02T04:01:28.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 9f9d5c57-93da-4e03-94c3-60b82f31db6e roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
14122024-11-02T04:01:28.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 9f9d5c57-93da-4e03-94c3-60b82f31db6e resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
14132024-11-02T04:01:28.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 9f9d5c57-93da-4e03-94c3-60b82f31db6e response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
14142024-11-02T04:01:29.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8d9e7c8b-ce5a-4a72-bc36-88afc3cab46e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14152024-11-02T04:01:29.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8d9e7c8b-ce5a-4a72-bc36-88afc3cab46e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14162024-11-02T04:01:29.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8d9e7c8b-ce5a-4a72-bc36-88afc3cab46e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14172024-11-02T04:01:30.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e4ea523-7d50-4cc0-8281-9bfc6ec3dfd0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14182024-11-02T04:01:30.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e4ea523-7d50-4cc0-8281-9bfc6ec3dfd0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14192024-11-02T04:01:30.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e4ea523-7d50-4cc0-8281-9bfc6ec3dfd0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14202024-11-02T04:01:31.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5abfc748-aaa5-44a8-a0f8-8e8989405b29 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14212024-11-02T04:01:31.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5abfc748-aaa5-44a8-a0f8-8e8989405b29 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14222024-11-02T04:01:31.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5abfc748-aaa5-44a8-a0f8-8e8989405b29 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14232024-11-02T04:01:32.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdc2291-3ec6-430d-9761-b62d9704b326 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14242024-11-02T04:01:32.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdc2291-3ec6-430d-9761-b62d9704b326 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14252024-11-02T04:01:32.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdc2291-3ec6-430d-9761-b62d9704b326 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14262024-11-02T04:01:33.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e0ba8a6f-87d6-4559-9f8e-f6b4b3c3b1a3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14272024-11-02T04:01:33.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e0ba8a6f-87d6-4559-9f8e-f6b4b3c3b1a3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14282024-11-02T04:01:33.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e0ba8a6f-87d6-4559-9f8e-f6b4b3c3b1a3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14292024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
14302024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14312024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
14322024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14332024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14342024-11-02T04:01:33.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14352024-11-02T04:01:33.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14362024-11-02T04:01:33.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14372024-11-02T04:01:33.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.320443ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14382024-11-02T04:01:33.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392024-11-02T04:01:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14402024-11-02T04:01:33.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14412024-11-02T04:01:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14422024-11-02T04:01:33.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14432024-11-02T04:01:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442024-11-02T04:01:33.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452024-11-02T04:01:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
14462024-11-02T04:01:33.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14472024-11-02T04:01:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14482024-11-02T04:01:33.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
14492024-11-02T04:01:33.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.081702ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
14502024-11-02T04:01:34.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b0ebfff-854f-44e4-87de-9b4820b715b5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14512024-11-02T04:01:34.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b0ebfff-854f-44e4-87de-9b4820b715b5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14522024-11-02T04:01:34.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b0ebfff-854f-44e4-87de-9b4820b715b5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14532024-11-02T04:01:35.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0efa21d9-e361-49f4-a3e6-863ab68d178b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14542024-11-02T04:01:35.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0efa21d9-e361-49f4-a3e6-863ab68d178b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14552024-11-02T04:01:35.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0efa21d9-e361-49f4-a3e6-863ab68d178b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14562024-11-02T04:01:36.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be865259-46d6-4bff-8ff5-f9e044f56a44 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14572024-11-02T04:01:36.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be865259-46d6-4bff-8ff5-f9e044f56a44 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14582024-11-02T04:01:36.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be865259-46d6-4bff-8ff5-f9e044f56a44 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14592024-11-02T04:01:37.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e5f7ba8-e4e3-4f5b-bd6e-8b50542211f5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14602024-11-02T04:01:37.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e5f7ba8-e4e3-4f5b-bd6e-8b50542211f5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14612024-11-02T04:01:37.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e5f7ba8-e4e3-4f5b-bd6e-8b50542211f5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14622024-11-02T04:01:38.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1dec770-3e0d-4ac8-9136-3624000ee3d6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14632024-11-02T04:01:38.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1dec770-3e0d-4ac8-9136-3624000ee3d6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14642024-11-02T04:01:38.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e1dec770-3e0d-4ac8-9136-3624000ee3d6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14652024-11-02T04:01:38.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 7e2b7400-5b86-466b-b660-6ed55f1d29d6 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
14662024-11-02T04:01:39.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e372ca6a-78b9-44d5-bb17-114a8d046ba9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14672024-11-02T04:01:39.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e372ca6a-78b9-44d5-bb17-114a8d046ba9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14682024-11-02T04:01:39.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e372ca6a-78b9-44d5-bb17-114a8d046ba9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14692024-11-02T04:01:40.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4cded88-98f9-47b6-8f5e-b743f6125841 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14702024-11-02T04:01:40.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4cded88-98f9-47b6-8f5e-b743f6125841 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14712024-11-02T04:01:40.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4cded88-98f9-47b6-8f5e-b743f6125841 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14722024-11-02T04:01:41.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 040e27ed-de6d-4207-90fd-e69815da36c6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14732024-11-02T04:01:41.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 040e27ed-de6d-4207-90fd-e69815da36c6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14742024-11-02T04:01:41.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 040e27ed-de6d-4207-90fd-e69815da36c6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14752024-11-02T04:01:42.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db980050-954a-41b5-b57c-4fd41dc485e6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14762024-11-02T04:01:42.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db980050-954a-41b5-b57c-4fd41dc485e6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14772024-11-02T04:01:42.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db980050-954a-41b5-b57c-4fd41dc485e6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14782024-11-02T04:01:43.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66406c39-7ecf-4640-b7f6-a8cb922d7785 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14792024-11-02T04:01:43.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66406c39-7ecf-4640-b7f6-a8cb922d7785 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14802024-11-02T04:01:43.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66406c39-7ecf-4640-b7f6-a8cb922d7785 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
14812024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
14822024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
14832024-11-02T04:01:43.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14842024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14852024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14862024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
14872024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
14882024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14892024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14902024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14912024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
14922024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
14932024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14942024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
14952024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14962024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14972024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
14982024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14992024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
15002024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15012024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
15022024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
15032024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15042024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
15052024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
15062024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15072024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15082024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15092024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15102024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15112024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15122024-11-02T04:01:43.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15132024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15142024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15152024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15162024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15172024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15182024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15192024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15202024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
15212024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
15222024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
15232024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.19\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
15242024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.941\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
15252024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
15262024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.08\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15272024-11-02T04:01:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.02\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15282024-11-02T04:01:43.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15292024-11-02T04:01:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.573315ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15302024-11-02T04:01:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-11-02T04:01:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322024-11-02T04:01:43.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15332024-11-02T04:01:43.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15342024-11-02T04:01:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15352024-11-02T04:01:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15362024-11-02T04:01:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15372024-11-02T04:01:43.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15382024-11-02T04:01:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15392024-11-02T04:01:43.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15402024-11-02T04:01:43.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15412024-11-02T04:01:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15422024-11-02T04:01:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15432024-11-02T04:01:43.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15442024-11-02T04:01:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15452024-11-02T04:01:43.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-11-02T04:01:43.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-11-02T04:01:43.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9607, tv_nsec: 526754277 } })
15482024-11-02T04:01:43.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
15492024-11-02T04:01:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15502024-11-02T04:01:43.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15512024-11-02T04:01:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15522024-11-02T04:01:43.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9607, tv_nsec: 529019776 } })
15532024-11-02T04:01:43.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
15542024-11-02T04:01:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15552024-11-02T04:01:43.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15562024-11-02T04:01:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15572024-11-02T04:01:43.552ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15582024-11-02T04:01:43.552ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15592024-11-02T04:01:43.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15602024-11-02T04:01:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15612024-11-02T04:01:43.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15622024-11-02T04:01:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15632024-11-02T04:01:43.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15642024-11-02T04:01:43.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9607, tv_nsec: 539796747 } })
15652024-11-02T04:01:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15662024-11-02T04:01:43.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
15672024-11-02T04:01:43.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-02T04:01:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15692024-11-02T04:01:43.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15702024-11-02T04:01:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15712024-11-02T04:01:43.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15722024-11-02T04:01:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15732024-11-02T04:01:43.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-11-02T04:01:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15752024-11-02T04:01:43.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15762024-11-02T04:01:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15772024-11-02T04:01:43.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15782024-11-02T04:01:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15792024-11-02T04:01:43.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15802024-11-02T04:01:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15812024-11-02T04:01:43.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.164912ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15822024-11-02T04:01:43.608ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15832024-11-02T04:01:43.608ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15842024-11-02T04:01:43.608ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.750235ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15852024-11-02T04:01:43.611ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15862024-11-02T04:01:43.611ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.018025ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15872024-11-02T04:01:43.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15882024-11-02T04:01:43.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15892024-11-02T04:01:43.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15902024-11-02T04:01:43.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15912024-11-02T04:01:43.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.746548ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15922024-11-02T04:01:43.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15932024-11-02T04:01:43.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
15942024-11-02T04:01:43.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15952024-11-02T04:01:43.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15962024-11-02T04:01:43.643ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
15972024-11-02T04:01:43.643ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15982024-11-02T04:01:43.644ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3559e6be-7c05-4c6e-973b-8582149e99a9", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
15992024-11-02T04:01:43.644ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16002024-11-02T04:01:43.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16012024-11-02T04:01:43.648ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
16022024-11-02T04:01:43.648ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.684073ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
16032024-11-02T04:01:43.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16042024-11-02T04:01:43.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16052024-11-02T04:01:43.679ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.022926ms iteration = 13 status = {"physical_disks_added":0}
16062024-11-02T04:01:43.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16072024-11-02T04:01:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16082024-11-02T04:01:43.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16092024-11-02T04:01:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16102024-11-02T04:01:43.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16112024-11-02T04:01:43.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16122024-11-02T04:01:43.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16132024-11-02T04:01:43.720ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16142024-11-02T04:01:43.721ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6792d742-cc5d-4a18-8f8c-24ead01867f6", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16152024-11-02T04:01:43.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16162024-11-02T04:01:43.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16172024-11-02T04:01:43.751ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16182024-11-02T04:01:43.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "90fb1d9f-8fe3-4b48-81a8-13325eb6b4a1", "content-length": "1", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16192024-11-02T04:01:43.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16202024-11-02T04:01:43.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16212024-11-02T04:01:43.784ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
16222024-11-02T04:01:43.784ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16232024-11-02T04:01:43.784ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99268d16-7dc7-495f-aa32-bab39b6f5d6f", "content-length": "26", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16242024-11-02T04:01:43.784ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16252024-11-02T04:01:43.786ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
16262024-11-02T04:01:43.786ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16272024-11-02T04:01:43.786ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16282024-11-02T04:01:43.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16292024-11-02T04:01:43.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-11-02T04:01:43.789ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 248.738892ms iteration = 10 status = null
16312024-11-02T04:01:43.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16322024-11-02T04:01:43.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16332024-11-02T04:01:43.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16342024-11-02T04:01:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
16352024-11-02T04:01:43.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16362024-11-02T04:01:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16372024-11-02T04:01:43.793ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 253.288909ms iteration = 10 status = 0
16382024-11-02T04:01:43.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392024-11-02T04:01:43.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16402024-11-02T04:01:43.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16412024-11-02T04:01:43.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16422024-11-02T04:01:43.829ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.564567ms iteration = 10 status = {}
16432024-11-02T04:01:43.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3e85e4d-df7e-4436-bbd9-9dc8f4682041", "content-length": "372", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16442024-11-02T04:01:43.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16452024-11-02T04:01:43.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16462024-11-02T04:01:43.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16472024-11-02T04:01:43.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16482024-11-02T04:01:43.927ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16492024-11-02T04:01:43.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16502024-11-02T04:01:43.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "266cbe0e-4a3c-4453-97fa-9b64997d5a04", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16512024-11-02T04:01:43.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16522024-11-02T04:01:43.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16532024-11-02T04:01:43.933ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16542024-11-02T04:01:43.934ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "831e06ce-83e8-485f-befe-fd2c59edf73f", "content-length": "691", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16552024-11-02T04:01:43.934ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16562024-11-02T04:01:43.934ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16572024-11-02T04:01:43.934ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16582024-11-02T04:01:43.935ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.466732ms iteration = 10 status = {}
16592024-11-02T04:01:43.936ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
16602024-11-02T04:01:43.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16612024-11-02T04:01:43.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16622024-11-02T04:01:43.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16632024-11-02T04:01:43.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16642024-11-02T04:01:43.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16652024-11-02T04:01:43.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16662024-11-02T04:01:43.942ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16672024-11-02T04:01:43.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16682024-11-02T04:01:43.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e4fc2509-7758-483e-9c18-82e2a908c0a6", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16692024-11-02T04:01:43.944ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.750541ms iteration = 11 status = {}
16702024-11-02T04:01:43.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16712024-11-02T04:01:43.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "684a0115-7017-4306-9d69-d8bfdca83c0f", "content-length": "134", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16722024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16732024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
16742024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16752024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16762024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16772024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16782024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16792024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16802024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16812024-11-02T04:01:43.946ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16822024-11-02T04:01:43.947ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
16832024-11-02T04:01:43.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16842024-11-02T04:01:43.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16852024-11-02T04:01:43.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16862024-11-02T04:01:43.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "636d88e9-9d2d-47ec-b3b5-365876e8c507", "content-length": "2", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16872024-11-02T04:01:43.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16882024-11-02T04:01:43.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eb81e90-bb67-42bc-8d90-9d4b397545c9", "content-length": "52", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16892024-11-02T04:01:43.949ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
16902024-11-02T04:01:43.949ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16912024-11-02T04:01:44.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d443715-df5c-47a3-896c-e2a418311416 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16922024-11-02T04:01:44.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d443715-df5c-47a3-896c-e2a418311416 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16932024-11-02T04:01:44.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d443715-df5c-47a3-896c-e2a418311416 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16942024-11-02T04:01:44.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b9fccc10-e716-4cc1-8537-b18663813585", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16952024-11-02T04:01:44.042ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
16962024-11-02T04:01:44.042ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16972024-11-02T04:01:44.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bfcd151-328c-4dff-811f-896e758ff1cf", "content-length": "682", "date": "Sat, 02 Nov 2024 04:01:43 GMT"} })
16982024-11-02T04:01:44.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16992024-11-02T04:01:44.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17002024-11-02T04:01:44.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17012024-11-02T04:01:44.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17022024-11-02T04:01:44.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17032024-11-02T04:01:44.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17042024-11-02T04:01:44.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17052024-11-02T04:01:44.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17062024-11-02T04:01:44.060ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.928096ms iteration = 10 status = {}
17072024-11-02T04:01:44.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c90e120c-e5a1-4cff-9401-3083d593c938 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17082024-11-02T04:01:44.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c90e120c-e5a1-4cff-9401-3083d593c938 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17092024-11-02T04:01:44.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c90e120c-e5a1-4cff-9401-3083d593c938 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17102024-11-02T04:01:45.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a233a20-83bc-40c3-8e46-16bd20c36075 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17112024-11-02T04:01:45.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a233a20-83bc-40c3-8e46-16bd20c36075 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17122024-11-02T04:01:45.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a233a20-83bc-40c3-8e46-16bd20c36075 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17132024-11-02T04:01:46.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1eaeb7-ad6c-4f5d-8a22-8bca8844ec9b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17142024-11-02T04:01:46.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1eaeb7-ad6c-4f5d-8a22-8bca8844ec9b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17152024-11-02T04:01:46.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1eaeb7-ad6c-4f5d-8a22-8bca8844ec9b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17162024-11-02T04:01:47.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6ff43c-0ed2-4f44-b955-6cb48daad6c6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17172024-11-02T04:01:47.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6ff43c-0ed2-4f44-b955-6cb48daad6c6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17182024-11-02T04:01:47.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a6ff43c-0ed2-4f44-b955-6cb48daad6c6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17192024-11-02T04:01:48.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b57a56f3-8553-4c75-b6f4-1839df3575d2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17202024-11-02T04:01:48.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b57a56f3-8553-4c75-b6f4-1839df3575d2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17212024-11-02T04:01:48.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b57a56f3-8553-4c75-b6f4-1839df3575d2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17222024-11-02T04:01:49.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 64c833e3-7c13-4aae-ae96-abc395f146ec roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17232024-11-02T04:01:49.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 64c833e3-7c13-4aae-ae96-abc395f146ec resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17242024-11-02T04:01:49.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 64c833e3-7c13-4aae-ae96-abc395f146ec response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17252024-11-02T04:01:50.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e05a34f-2050-424e-a639-2ddf92504885 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17262024-11-02T04:01:50.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e05a34f-2050-424e-a639-2ddf92504885 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17272024-11-02T04:01:50.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e05a34f-2050-424e-a639-2ddf92504885 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17282024-11-02T04:01:51.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c6ab42e-0aeb-49dc-ba1e-f53579282657 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17292024-11-02T04:01:51.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c6ab42e-0aeb-49dc-ba1e-f53579282657 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17302024-11-02T04:01:51.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c6ab42e-0aeb-49dc-ba1e-f53579282657 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17312024-11-02T04:01:52.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a117408e-0711-457a-bd12-431a96494c06 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17322024-11-02T04:01:52.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a117408e-0711-457a-bd12-431a96494c06 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17332024-11-02T04:01:52.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a117408e-0711-457a-bd12-431a96494c06 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17342024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
17352024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
17362024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17372024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-11-02T04:01:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17402024-11-02T04:01:53.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17412024-11-02T04:01:53.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17422024-11-02T04:01:53.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17432024-11-02T04:01:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17442024-11-02T04:01:53.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17452024-11-02T04:01:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17462024-11-02T04:01:53.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17472024-11-02T04:01:53.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17482024-11-02T04:01:53.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492024-11-02T04:01:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
17502024-11-02T04:01:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17512024-11-02T04:01:53.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17522024-11-02T04:01:53.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
17532024-11-02T04:01:53.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.790085ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
17542024-11-02T04:01:53.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.722622ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17552024-11-02T04:01:53.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87746e1d-9ebc-4134-a91b-f327a41c4001 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17562024-11-02T04:01:53.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87746e1d-9ebc-4134-a91b-f327a41c4001 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17572024-11-02T04:01:53.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87746e1d-9ebc-4134-a91b-f327a41c4001 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17582024-11-02T04:01:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 7a10bc67-feca-4462-be88-c9c4d6b309b1 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
17592024-11-02T04:01:54.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c212b0cd-184f-46a4-9622-cf351f69edb7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17602024-11-02T04:01:54.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c212b0cd-184f-46a4-9622-cf351f69edb7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17612024-11-02T04:01:54.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c212b0cd-184f-46a4-9622-cf351f69edb7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17622024-11-02T04:01:55.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f941f0d6-4cbc-4702-b105-77d0a3f0dbca roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17632024-11-02T04:01:55.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f941f0d6-4cbc-4702-b105-77d0a3f0dbca resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17642024-11-02T04:01:55.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f941f0d6-4cbc-4702-b105-77d0a3f0dbca response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17652024-11-02T04:01:56.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 418e50f0-bd69-449e-a0e3-a28be7b20814 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17662024-11-02T04:01:56.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 418e50f0-bd69-449e-a0e3-a28be7b20814 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17672024-11-02T04:01:56.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 418e50f0-bd69-449e-a0e3-a28be7b20814 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17682024-11-02T04:01:57.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8127b5ec-20d1-486f-9a16-923c15aa9597 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17692024-11-02T04:01:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8127b5ec-20d1-486f-9a16-923c15aa9597 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17702024-11-02T04:01:57.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8127b5ec-20d1-486f-9a16-923c15aa9597 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17712024-11-02T04:01:58.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3bfc15a1-c601-4544-a19c-1f5bc1235484 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17722024-11-02T04:01:58.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3bfc15a1-c601-4544-a19c-1f5bc1235484 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17732024-11-02T04:01:58.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3bfc15a1-c601-4544-a19c-1f5bc1235484 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17742024-11-02T04:01:58.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 05746d93-b358-48f2-9235-a563bc4610f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
17752024-11-02T04:01:58.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 05746d93-b358-48f2-9235-a563bc4610f2 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
17762024-11-02T04:01:58.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 05746d93-b358-48f2-9235-a563bc4610f2 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
17772024-11-02T04:01:58.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 09531d2d-e483-4ff0-b13a-b0ebd2e8e429 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
17782024-11-02T04:01:58.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 09531d2d-e483-4ff0-b13a-b0ebd2e8e429 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
17792024-11-02T04:01:58.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44399 req_id = 09531d2d-e483-4ff0-b13a-b0ebd2e8e429 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
17802024-11-02T04:01:59.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99ee6afc-b6d7-4e2c-b8dc-7061cd8b4bb2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17812024-11-02T04:01:59.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99ee6afc-b6d7-4e2c-b8dc-7061cd8b4bb2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17822024-11-02T04:01:59.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99ee6afc-b6d7-4e2c-b8dc-7061cd8b4bb2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17832024-11-02T04:02:00.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 853f471c-ccb0-4552-9635-14f8623ea78f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17842024-11-02T04:02:00.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 853f471c-ccb0-4552-9635-14f8623ea78f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17852024-11-02T04:02:00.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 853f471c-ccb0-4552-9635-14f8623ea78f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17862024-11-02T04:02:01.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e8dca23-792c-4a61-bbfb-8c913d0f4682 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17872024-11-02T04:02:01.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e8dca23-792c-4a61-bbfb-8c913d0f4682 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17882024-11-02T04:02:01.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e8dca23-792c-4a61-bbfb-8c913d0f4682 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17892024-11-02T04:02:02.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73fa01c-95f4-46e0-891a-59d0a1dbf451 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17902024-11-02T04:02:02.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73fa01c-95f4-46e0-891a-59d0a1dbf451 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17912024-11-02T04:02:02.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73fa01c-95f4-46e0-891a-59d0a1dbf451 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
17922024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
17932024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17942024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
17952024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17972024-11-02T04:02:03.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982024-11-02T04:02:03.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-11-02T04:02:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18002024-11-02T04:02:03.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18012024-11-02T04:02:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18022024-11-02T04:02:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18032024-11-02T04:02:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18042024-11-02T04:02:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052024-11-02T04:02:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
18062024-11-02T04:02:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18072024-11-02T04:02:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-11-02T04:02:03.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
18092024-11-02T04:02:03.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.501383ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
18102024-11-02T04:02:03.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18112024-11-02T04:02:03.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18122024-11-02T04:02:03.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.248876ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18132024-11-02T04:02:03.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1764310e-e4d3-4710-b325-e2ebd0563606 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18142024-11-02T04:02:03.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1764310e-e4d3-4710-b325-e2ebd0563606 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18152024-11-02T04:02:03.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1764310e-e4d3-4710-b325-e2ebd0563606 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18162024-11-02T04:02:04.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e03d12b-c9f2-479b-802d-69452612cdd4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18172024-11-02T04:02:04.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e03d12b-c9f2-479b-802d-69452612cdd4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18182024-11-02T04:02:04.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e03d12b-c9f2-479b-802d-69452612cdd4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18192024-11-02T04:02:05.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb9cf99c-24a7-47c8-a89b-f385708f4edb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18202024-11-02T04:02:05.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb9cf99c-24a7-47c8-a89b-f385708f4edb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18212024-11-02T04:02:05.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb9cf99c-24a7-47c8-a89b-f385708f4edb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18222024-11-02T04:02:07.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f57446c-78dd-4a44-bdf6-36dd994750e4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18232024-11-02T04:02:07.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f57446c-78dd-4a44-bdf6-36dd994750e4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18242024-11-02T04:02:07.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f57446c-78dd-4a44-bdf6-36dd994750e4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18252024-11-02T04:02:08.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97eff8f2-be86-4c1a-92c9-9b046d1212f4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18262024-11-02T04:02:08.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97eff8f2-be86-4c1a-92c9-9b046d1212f4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18272024-11-02T04:02:08.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97eff8f2-be86-4c1a-92c9-9b046d1212f4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18282024-11-02T04:02:08.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = a08e7bdf-700f-4d81-b3e0-28f2fb21838e response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
18292024-11-02T04:02:09.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c198baa7-41e9-4675-879f-aee9b6e2b16e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18302024-11-02T04:02:09.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c198baa7-41e9-4675-879f-aee9b6e2b16e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18312024-11-02T04:02:09.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c198baa7-41e9-4675-879f-aee9b6e2b16e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18322024-11-02T04:02:10.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92884ea-5bcf-4a9a-98ad-0c4530f4f49f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18332024-11-02T04:02:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92884ea-5bcf-4a9a-98ad-0c4530f4f49f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18342024-11-02T04:02:10.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92884ea-5bcf-4a9a-98ad-0c4530f4f49f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18352024-11-02T04:02:11.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1becc94f-8bb4-475e-85c4-655778cc582f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18362024-11-02T04:02:11.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1becc94f-8bb4-475e-85c4-655778cc582f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18372024-11-02T04:02:11.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1becc94f-8bb4-475e-85c4-655778cc582f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18382024-11-02T04:02:12.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2679129e-b2df-4ca8-a1e9-d46989f371a1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18392024-11-02T04:02:12.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2679129e-b2df-4ca8-a1e9-d46989f371a1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18402024-11-02T04:02:12.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2679129e-b2df-4ca8-a1e9-d46989f371a1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18412024-11-02T04:02:13.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 300df0d8-05f6-4bbc-8464-31657d13abed roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18422024-11-02T04:02:13.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 300df0d8-05f6-4bbc-8464-31657d13abed resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18432024-11-02T04:02:13.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 300df0d8-05f6-4bbc-8464-31657d13abed response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
18442024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
18452024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
18462024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
18472024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
18482024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18492024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18502024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
18512024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
18522024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18532024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18542024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
18552024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
18562024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18572024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18582024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18592024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
18602024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
18612024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18622024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18632024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
18642024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18652024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18662024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
18672024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18682024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
18692024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
18702024-11-02T04:02:13.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18712024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18722024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
18732024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
18742024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18752024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
18762024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18772024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
18782024-11-02T04:02:13.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
18792024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.07\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
18802024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
18812024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
18822024-11-02T04:02:13.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:52:13.540612499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18832024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
18842024-11-02T04:02:13.540ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
18852024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18862024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18872024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
18882024-11-02T04:02:13.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18892024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18902024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
18912024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18922024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18932024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
18942024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
18952024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18962024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18972024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18982024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18992024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19002024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19012024-11-02T04:02:13.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19022024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19032024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19042024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19052024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19062024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19072024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19082024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19092024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19102024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19112024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19122024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19132024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19142024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
19152024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
19162024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19172024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19182024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
19192024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
19202024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
19212024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.31\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19222024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.82\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19232024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.38\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
19242024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19252024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
19262024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.11\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
19272024-11-02T04:02:13.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9637, tv_nsec: 518918669 } })
19282024-11-02T04:02:13.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9637, tv_nsec: 518942479 } })
19292024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19302024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19312024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19322024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
19332024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.153165ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
19342024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
19352024-11-02T04:02:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.315548ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
19362024-11-02T04:02:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19372024-11-02T04:02:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19382024-11-02T04:02:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19392024-11-02T04:02:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.323363ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19402024-11-02T04:02:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19412024-11-02T04:02:13.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19422024-11-02T04:02:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19432024-11-02T04:02:13.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19442024-11-02T04:02:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19452024-11-02T04:02:13.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9637, tv_nsec: 526981762 } })
19462024-11-02T04:02:13.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
19472024-11-02T04:02:13.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19482024-11-02T04:02:13.552ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:52:13.540612499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19492024-11-02T04:02:13.552ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.440666ms iteration = 6 status = {"expiration":"2024-11-02T03:52:13.540612499Z","pruned":[]}
19502024-11-02T04:02:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19512024-11-02T04:02:13.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19522024-11-02T04:02:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19532024-11-02T04:02:13.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9637, tv_nsec: 534691457 } })
19542024-11-02T04:02:13.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19552024-11-02T04:02:13.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
19562024-11-02T04:02:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19572024-11-02T04:02:13.560ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.58377ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
19582024-11-02T04:02:13.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592024-11-02T04:02:13.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19602024-11-02T04:02:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19612024-11-02T04:02:13.563ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9637, tv_nsec: 540963262 } })
19622024-11-02T04:02:13.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
19632024-11-02T04:02:13.565ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19642024-11-02T04:02:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19652024-11-02T04:02:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19662024-11-02T04:02:13.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-11-02T04:02:13.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19682024-11-02T04:02:13.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19692024-11-02T04:02:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19702024-11-02T04:02:13.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19712024-11-02T04:02:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19722024-11-02T04:02:13.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19732024-11-02T04:02:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19742024-11-02T04:02:13.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19752024-11-02T04:02:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19762024-11-02T04:02:13.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19772024-11-02T04:02:13.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.840988ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19782024-11-02T04:02:13.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19792024-11-02T04:02:13.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19802024-11-02T04:02:13.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19812024-11-02T04:02:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19822024-11-02T04:02:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19832024-11-02T04:02:13.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19842024-11-02T04:02:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19852024-11-02T04:02:13.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19862024-11-02T04:02:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19872024-11-02T04:02:13.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882024-11-02T04:02:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19892024-11-02T04:02:13.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19902024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19912024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19922024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19932024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19942024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19952024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19962024-11-02T04:02:13.603ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19972024-11-02T04:02:13.603ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.520462ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19982024-11-02T04:02:13.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992024-11-02T04:02:13.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002024-11-02T04:02:13.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20012024-11-02T04:02:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20022024-11-02T04:02:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20032024-11-02T04:02:13.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20042024-11-02T04:02:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20052024-11-02T04:02:13.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20062024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20072024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20082024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20092024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20102024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20112024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20122024-11-02T04:02:13.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20132024-11-02T04:02:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20142024-11-02T04:02:13.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20152024-11-02T04:02:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20162024-11-02T04:02:13.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20172024-11-02T04:02:13.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20182024-11-02T04:02:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20192024-11-02T04:02:13.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202024-11-02T04:02:13.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20212024-11-02T04:02:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20222024-11-02T04:02:13.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232024-11-02T04:02:13.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20242024-11-02T04:02:13.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.027036ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20252024-11-02T04:02:13.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20262024-11-02T04:02:13.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20272024-11-02T04:02:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20282024-11-02T04:02:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20292024-11-02T04:02:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
20302024-11-02T04:02:13.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20312024-11-02T04:02:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20322024-11-02T04:02:13.621ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20332024-11-02T04:02:13.621ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20342024-11-02T04:02:13.621ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20352024-11-02T04:02:13.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20362024-11-02T04:02:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20372024-11-02T04:02:13.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20382024-11-02T04:02:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20392024-11-02T04:02:13.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20402024-11-02T04:02:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20412024-11-02T04:02:13.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20422024-11-02T04:02:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20432024-11-02T04:02:13.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
20442024-11-02T04:02:13.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.21839ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
20452024-11-02T04:02:13.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.124827ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20462024-11-02T04:02:13.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20472024-11-02T04:02:13.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20482024-11-02T04:02:13.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20492024-11-02T04:02:13.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20502024-11-02T04:02:13.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512024-11-02T04:02:13.646ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20522024-11-02T04:02:13.646ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20532024-11-02T04:02:13.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20542024-11-02T04:02:13.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-11-02T04:02:13.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20562024-11-02T04:02:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20572024-11-02T04:02:13.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20582024-11-02T04:02:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20592024-11-02T04:02:13.649ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20602024-11-02T04:02:13.649ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20612024-11-02T04:02:13.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.232746ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20622024-11-02T04:02:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
20632024-11-02T04:02:13.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20642024-11-02T04:02:13.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20652024-11-02T04:02:13.652ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.620567ms iteration = 11 status = 0
20662024-11-02T04:02:13.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-11-02T04:02:13.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20682024-11-02T04:02:13.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20692024-11-02T04:02:13.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20702024-11-02T04:02:13.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20712024-11-02T04:02:13.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20722024-11-02T04:02:13.659ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20732024-11-02T04:02:13.659ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20742024-11-02T04:02:13.659ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.795011ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20752024-11-02T04:02:13.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-11-02T04:02:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20772024-11-02T04:02:13.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20782024-11-02T04:02:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20792024-11-02T04:02:13.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20802024-11-02T04:02:13.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20812024-11-02T04:02:13.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20822024-11-02T04:02:13.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20832024-11-02T04:02:13.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20842024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20852024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20862024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20872024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20882024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20892024-11-02T04:02:13.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20902024-11-02T04:02:13.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20912024-11-02T04:02:13.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20922024-11-02T04:02:13.668ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20932024-11-02T04:02:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20942024-11-02T04:02:13.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20952024-11-02T04:02:13.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20962024-11-02T04:02:13.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
20972024-11-02T04:02:13.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20982024-11-02T04:02:13.679ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c8d6e5-942c-428e-92e9-e329f60cfba7", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:12 GMT"} })
20992024-11-02T04:02:13.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21002024-11-02T04:02:13.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21012024-11-02T04:02:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21022024-11-02T04:02:13.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21032024-11-02T04:02:13.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21042024-11-02T04:02:13.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21052024-11-02T04:02:13.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21062024-11-02T04:02:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21072024-11-02T04:02:13.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21082024-11-02T04:02:13.706ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21092024-11-02T04:02:13.706ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
21102024-11-02T04:02:13.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21112024-11-02T04:02:13.706ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
21122024-11-02T04:02:13.706ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21132024-11-02T04:02:13.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21142024-11-02T04:02:13.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3460545e-651a-49ae-ad51-e4f58f28e4dc", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:12 GMT"} })
21152024-11-02T04:02:13.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21162024-11-02T04:02:13.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
21172024-11-02T04:02:13.708ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21182024-11-02T04:02:13.708ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a8572a-4cf9-4fc3-8c55-08213d72ec8a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:12 GMT"} })
21192024-11-02T04:02:13.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21202024-11-02T04:02:13.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21212024-11-02T04:02:13.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21222024-11-02T04:02:13.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21232024-11-02T04:02:13.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21242024-11-02T04:02:13.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
21252024-11-02T04:02:13.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21262024-11-02T04:02:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21272024-11-02T04:02:13.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21282024-11-02T04:02:13.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21292024-11-02T04:02:13.713ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21302024-11-02T04:02:13.713ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21312024-11-02T04:02:13.713ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
21322024-11-02T04:02:13.713ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 172.703079ms iteration = 7 status = {"generation":1}
21332024-11-02T04:02:13.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21342024-11-02T04:02:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21352024-11-02T04:02:13.729ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.547059ms iteration = 14 status = {"physical_disks_added":0}
21362024-11-02T04:02:13.739ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
21372024-11-02T04:02:13.739ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.116117ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21382024-11-02T04:02:13.745ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
21392024-11-02T04:02:13.745ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 205.296509ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21402024-11-02T04:02:13.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21412024-11-02T04:02:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21422024-11-02T04:02:13.840ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21432024-11-02T04:02:13.840ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "afaba470-54d2-4c54-b639-c43a96ffdc7d", "content-length": "1", "date": "Sat, 02 Nov 2024 04:02:12 GMT"} })
21442024-11-02T04:02:13.841ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21452024-11-02T04:02:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21462024-11-02T04:02:13.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21472024-11-02T04:02:13.846ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "babbcb67-34e4-4cba-a308-70085e88c067", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21482024-11-02T04:02:13.846ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21492024-11-02T04:02:13.848ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "06f76654-7f30-4142-ba22-827780fbc5ba", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21502024-11-02T04:02:13.848ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21512024-11-02T04:02:13.849ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21522024-11-02T04:02:13.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 309.400825ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21532024-11-02T04:02:13.864ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21542024-11-02T04:02:13.864ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21552024-11-02T04:02:13.864ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f377cfeb-48db-4195-b51a-244435d07533", "content-length": "372", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} })
21562024-11-02T04:02:13.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21572024-11-02T04:02:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21582024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
21592024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21602024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
21612024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 325.849218ms iteration = 7 status = {"generation":2}
21622024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21632024-11-02T04:02:13.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21642024-11-02T04:02:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21652024-11-02T04:02:13.867ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.808999ms iteration = 11 status = null
21662024-11-02T04:02:13.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21672024-11-02T04:02:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21682024-11-02T04:02:13.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21692024-11-02T04:02:13.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21702024-11-02T04:02:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21712024-11-02T04:02:13.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21722024-11-02T04:02:13.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732024-11-02T04:02:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21742024-11-02T04:02:13.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21752024-11-02T04:02:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21762024-11-02T04:02:13.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21772024-11-02T04:02:13.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21782024-11-02T04:02:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21792024-11-02T04:02:13.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21802024-11-02T04:02:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21812024-11-02T04:02:13.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822024-11-02T04:02:13.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21832024-11-02T04:02:13.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21842024-11-02T04:02:13.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21852024-11-02T04:02:13.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21862024-11-02T04:02:13.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21872024-11-02T04:02:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21882024-11-02T04:02:13.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21892024-11-02T04:02:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21902024-11-02T04:02:13.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21912024-11-02T04:02:13.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21922024-11-02T04:02:13.922ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21932024-11-02T04:02:13.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21942024-11-02T04:02:13.923ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c27dfa2f-4f5e-4835-b4a4-93bccd67d899", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} })
21952024-11-02T04:02:13.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21962024-11-02T04:02:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21972024-11-02T04:02:13.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21982024-11-02T04:02:13.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21992024-11-02T04:02:13.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22002024-11-02T04:02:13.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22012024-11-02T04:02:13.926ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22022024-11-02T04:02:13.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22032024-11-02T04:02:13.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22042024-11-02T04:02:13.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22052024-11-02T04:02:13.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22062024-11-02T04:02:13.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22072024-11-02T04:02:13.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082024-11-02T04:02:13.930ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22092024-11-02T04:02:13.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22102024-11-02T04:02:13.931ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c017b18b-3991-4bd7-9a56-e2325d27dc57", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} })
22112024-11-02T04:02:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.924827ms iteration = 12 status = {}
22122024-11-02T04:02:13.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22132024-11-02T04:02:13.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22142024-11-02T04:02:13.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22152024-11-02T04:02:13.934ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22162024-11-02T04:02:13.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22172024-11-02T04:02:13.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22182024-11-02T04:02:13.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22192024-11-02T04:02:13.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22202024-11-02T04:02:13.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
22212024-11-02T04:02:13.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22222024-11-02T04:02:13.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22232024-11-02T04:02:13.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22242024-11-02T04:02:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22252024-11-02T04:02:13.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22262024-11-02T04:02:13.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22272024-11-02T04:02:13.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22282024-11-02T04:02:13.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22292024-11-02T04:02:13.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22302024-11-02T04:02:13.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22312024-11-02T04:02:13.950ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 409.963834ms iteration = 11 status = {}
22322024-11-02T04:02:14.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22332024-11-02T04:02:14.013ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94d7cd4-0e26-4b22-aabd-4d214012d968", "content-length": "691", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} })
22342024-11-02T04:02:14.013ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22352024-11-02T04:02:14.013ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22362024-11-02T04:02:14.013ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22372024-11-02T04:02:14.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22382024-11-02T04:02:14.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22392024-11-02T04:02:14.016ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.688706ms iteration = 11 status = {}
22402024-11-02T04:02:14.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22412024-11-02T04:02:14.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22422024-11-02T04:02:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22432024-11-02T04:02:14.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1ff016e6-58a5-4c12-9495-b5c60783a19c", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22442024-11-02T04:02:14.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22452024-11-02T04:02:14.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22462024-11-02T04:02:14.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22472024-11-02T04:02:14.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a8400fe8-4efb-4b96-8a90-dcecec3c1cef", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22482024-11-02T04:02:14.020ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22492024-11-02T04:02:14.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22502024-11-02T04:02:14.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5ca1e325-3d63-4866-9cb6-04eee17b8a17", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22512024-11-02T04:02:14.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22522024-11-02T04:02:14.023ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
22532024-11-02T04:02:14.023ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.601945ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22542024-11-02T04:02:14.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22552024-11-02T04:02:14.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22562024-11-02T04:02:14.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22572024-11-02T04:02:14.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22582024-11-02T04:02:14.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22592024-11-02T04:02:14.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22602024-11-02T04:02:14.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22612024-11-02T04:02:14.038ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
22622024-11-02T04:02:14.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22632024-11-02T04:02:14.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22642024-11-02T04:02:14.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22652024-11-02T04:02:14.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf8b0b87-d3c8-43fa-bb03-75828e4f4057", "content-length": "134", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} })
22662024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22672024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
22682024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22692024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22702024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22712024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22722024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22732024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22742024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22752024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22762024-11-02T04:02:14.049ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
22772024-11-02T04:02:14.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22782024-11-02T04:02:14.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22792024-11-02T04:02:14.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22802024-11-02T04:02:14.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fcc1d8a-97f8-4e7a-aaed-40f12d95b3a9", "content-length": "2", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} })
22812024-11-02T04:02:14.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22822024-11-02T04:02:14.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "375769a9-e534-4367-b4d4-9bf165b8f154", "content-length": "52", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} })
22832024-11-02T04:02:14.052ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
22842024-11-02T04:02:14.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22852024-11-02T04:02:14.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22862024-11-02T04:02:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22872024-11-02T04:02:14.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22882024-11-02T04:02:14.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 8c85a654-ab2c-49d7-b5e5-df979a5b627a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22892024-11-02T04:02:14.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 8c85a654-ab2c-49d7-b5e5-df979a5b627a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22902024-11-02T04:02:14.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22912024-11-02T04:02:14.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22922024-11-02T04:02:14.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22932024-11-02T04:02:14.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 8c85a654-ab2c-49d7-b5e5-df979a5b627a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22942024-11-02T04:02:14.068ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
22952024-11-02T04:02:14.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22962024-11-02T04:02:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22972024-11-02T04:02:14.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982024-11-02T04:02:14.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
22992024-11-02T04:02:14.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23002024-11-02T04:02:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23012024-11-02T04:02:14.076ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
23022024-11-02T04:02:14.076ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
23032024-11-02T04:02:14.076ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
23042024-11-02T04:02:14.133ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, time_created: 2024-11-02T03:57:50.261091Z, time_modified: 2024-11-02T03:57:50.261091Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e190f004-2376-4aae-8296-5a5757dc1123, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
23052024-11-02T04:02:14.133ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
23062024-11-02T04:02:14.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23072024-11-02T04:02:14.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23082024-11-02T04:02:14.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23092024-11-02T04:02:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23102024-11-02T04:02:14.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112024-11-02T04:02:14.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
23122024-11-02T04:02:14.163ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a56a8c56-6ba3-4cd5-8b59-a113ef3ee290", "date": "Sat, 02 Nov 2024 04:02:13 GMT"} })
23132024-11-02T04:02:14.163ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
23142024-11-02T04:02:14.163ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23152024-11-02T04:02:14.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 88103fa9-5d4d-40d5-a2f7-2dcea6cf9835 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23162024-11-02T04:02:14.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 88103fa9-5d4d-40d5-a2f7-2dcea6cf9835 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23172024-11-02T04:02:14.164ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1acebce1-a447-4b50-83c0-c4bfc4837989", "content-length": "682", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} })
23182024-11-02T04:02:14.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23192024-11-02T04:02:14.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23202024-11-02T04:02:14.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 88103fa9-5d4d-40d5-a2f7-2dcea6cf9835 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23212024-11-02T04:02:14.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23222024-11-02T04:02:14.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23232024-11-02T04:02:14.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23242024-11-02T04:02:14.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23252024-11-02T04:02:14.171ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23262024-11-02T04:02:14.175ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "5389cd5e-773e-464e-bff8-b39cdcb14950", "date": "Sat, 02 Nov 2024 04:02:14 GMT"} })
23272024-11-02T04:02:14.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23282024-11-02T04:02:14.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23292024-11-02T04:02:14.176ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
23302024-11-02T04:02:14.176ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 636.287784ms
23312024-11-02T04:02:14.176ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 636.297845ms iteration = 2 status = {}
23322024-11-02T04:02:14.182ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 642.297934ms iteration = 11 status = {}
23332024-11-02T04:02:15.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b160334-ca46-4e3b-af5e-d27233ae56da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23342024-11-02T04:02:15.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b160334-ca46-4e3b-af5e-d27233ae56da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23352024-11-02T04:02:15.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b160334-ca46-4e3b-af5e-d27233ae56da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23362024-11-02T04:02:16.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7679f6bc-0cfc-4cfe-a171-c17f671092d8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23372024-11-02T04:02:16.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7679f6bc-0cfc-4cfe-a171-c17f671092d8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23382024-11-02T04:02:16.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7679f6bc-0cfc-4cfe-a171-c17f671092d8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23392024-11-02T04:02:17.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 732d3d20-f20e-4d29-995d-b94d286cc8ca roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23402024-11-02T04:02:17.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 732d3d20-f20e-4d29-995d-b94d286cc8ca resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23412024-11-02T04:02:17.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 732d3d20-f20e-4d29-995d-b94d286cc8ca response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23422024-11-02T04:02:18.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5897866f-a9dc-4269-a004-61127c525417 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23432024-11-02T04:02:18.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5897866f-a9dc-4269-a004-61127c525417 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23442024-11-02T04:02:18.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5897866f-a9dc-4269-a004-61127c525417 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23452024-11-02T04:02:18.807ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:47157
23462024-11-02T04:02:18.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47157 req_id = e43c1260-e10b-4e19-bcd5-d5d7141ca7d2 roles = RoleSet { roles: {} } uri = /metrics/producers
23472024-11-02T04:02:18.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47157 req_id = e43c1260-e10b-4e19-bcd5-d5d7141ca7d2 resource = Database result = Ok(()) uri = /metrics/producers
23482024-11-02T04:02:18.848ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 6b8d67f3-a714-4683-8553-09335a4a9d26
23492024-11-02T04:02:18.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41136 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47157 req_id = e43c1260-e10b-4e19-bcd5-d5d7141ca7d2 response_code = 201 uri = /metrics/producers
23502024-11-02T04:02:19.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79d4fd80-fd02-42ad-9f6c-f95a38e3e8f7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23512024-11-02T04:02:19.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79d4fd80-fd02-42ad-9f6c-f95a38e3e8f7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23522024-11-02T04:02:19.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79d4fd80-fd02-42ad-9f6c-f95a38e3e8f7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23532024-11-02T04:02:20.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad3d1dfe-1f2b-4a52-8de9-7a0357a540f9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23542024-11-02T04:02:20.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad3d1dfe-1f2b-4a52-8de9-7a0357a540f9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23552024-11-02T04:02:20.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad3d1dfe-1f2b-4a52-8de9-7a0357a540f9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23562024-11-02T04:02:20.488ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:51827
23572024-11-02T04:02:20.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51827 req_id = 2fca8791-fd38-418c-ae96-eb67dab1152d roles = RoleSet { roles: {} } uri = /metrics/producers
23582024-11-02T04:02:20.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51827 req_id = 2fca8791-fd38-418c-ae96-eb67dab1152d resource = Database result = Ok(()) uri = /metrics/producers
23592024-11-02T04:02:20.524ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = bbe1fec9-a47f-440b-bc9d-2726d77e81dc
23602024-11-02T04:02:20.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34311 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51827 req_id = 2fca8791-fd38-418c-ae96-eb67dab1152d response_code = 201 uri = /metrics/producers
23612024-11-02T04:02:21.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8af33b55-1598-4794-b8b9-8f97e5ec7820 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23622024-11-02T04:02:21.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8af33b55-1598-4794-b8b9-8f97e5ec7820 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23632024-11-02T04:02:21.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8af33b55-1598-4794-b8b9-8f97e5ec7820 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23642024-11-02T04:02:21.877ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48849
23652024-11-02T04:02:21.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48849 req_id = 7a829bda-92e3-47c0-8a61-33445908037e roles = RoleSet { roles: {} } uri = /metrics/producers
23662024-11-02T04:02:21.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48849 req_id = 7a829bda-92e3-47c0-8a61-33445908037e resource = Database result = Ok(()) uri = /metrics/producers
23672024-11-02T04:02:21.885ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d565c44-21ca-41c0-b1d4-bcace41c9902
23682024-11-02T04:02:21.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8101 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48849 req_id = 7a829bda-92e3-47c0-8a61-33445908037e response_code = 201 uri = /metrics/producers
23692024-11-02T04:02:21.919ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35191
23702024-11-02T04:02:21.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35191 req_id = c11490b3-6bd2-49ac-9768-cdf855cf54da roles = RoleSet { roles: {} } uri = /metrics/producers
23712024-11-02T04:02:21.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35191 req_id = c11490b3-6bd2-49ac-9768-cdf855cf54da resource = Database result = Ok(()) uri = /metrics/producers
23722024-11-02T04:02:21.954ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = df01f79b-0682-4f1b-aa97-1a8bb18b9157
23732024-11-02T04:02:21.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34664 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35191 req_id = c11490b3-6bd2-49ac-9768-cdf855cf54da response_code = 201 uri = /metrics/producers
23742024-11-02T04:02:22.168ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35601
23752024-11-02T04:02:22.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35601 req_id = e2feccc7-f95d-434f-b5cf-fff14cd229fe roles = RoleSet { roles: {} } uri = /metrics/producers
23762024-11-02T04:02:22.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35601 req_id = e2feccc7-f95d-434f-b5cf-fff14cd229fe resource = Database result = Ok(()) uri = /metrics/producers
23772024-11-02T04:02:22.202ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 84e94f83-f18a-4122-a272-bfe20f1486da
23782024-11-02T04:02:22.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33934 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35601 req_id = e2feccc7-f95d-434f-b5cf-fff14cd229fe response_code = 201 uri = /metrics/producers
23792024-11-02T04:02:22.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8010846-35c0-4005-8364-d850e78fc73d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23802024-11-02T04:02:22.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8010846-35c0-4005-8364-d850e78fc73d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23812024-11-02T04:02:22.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8010846-35c0-4005-8364-d850e78fc73d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23822024-11-02T04:02:23.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edae9c83-8f0d-4c75-9e47-151e822c8e7b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23832024-11-02T04:02:23.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edae9c83-8f0d-4c75-9e47-151e822c8e7b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23842024-11-02T04:02:23.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edae9c83-8f0d-4c75-9e47-151e822c8e7b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
23852024-11-02T04:02:23.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
23862024-11-02T04:02:23.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23872024-11-02T04:02:23.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
23882024-11-02T04:02:23.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23892024-11-02T04:02:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23902024-11-02T04:02:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23912024-11-02T04:02:23.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922024-11-02T04:02:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23932024-11-02T04:02:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23942024-11-02T04:02:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23952024-11-02T04:02:23.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23962024-11-02T04:02:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23972024-11-02T04:02:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982024-11-02T04:02:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
23992024-11-02T04:02:23.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24002024-11-02T04:02:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24012024-11-02T04:02:23.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
24022024-11-02T04:02:23.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.775098ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
24032024-11-02T04:02:23.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24042024-11-02T04:02:23.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24052024-11-02T04:02:23.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.980788ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24062024-11-02T04:02:23.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1417 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 8f9bb451-c452-4d1b-9489-ef0688c1ee92 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
24072024-11-02T04:02:24.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cf174bd2-563f-494e-b14d-f375b379b4db roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24082024-11-02T04:02:24.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cf174bd2-563f-494e-b14d-f375b379b4db resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24092024-11-02T04:02:24.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cf174bd2-563f-494e-b14d-f375b379b4db response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24102024-11-02T04:02:25.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49b230b4-53a4-4e4a-a1ce-e96380989463 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24112024-11-02T04:02:25.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49b230b4-53a4-4e4a-a1ce-e96380989463 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24122024-11-02T04:02:25.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49b230b4-53a4-4e4a-a1ce-e96380989463 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24132024-11-02T04:02:26.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9456f1f-a39f-4cfa-8f00-92c1ce1d906a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24142024-11-02T04:02:26.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9456f1f-a39f-4cfa-8f00-92c1ce1d906a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24152024-11-02T04:02:26.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9456f1f-a39f-4cfa-8f00-92c1ce1d906a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24162024-11-02T04:02:27.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44bd6ed1-8ce7-4be5-b94e-9ac1ab211bc5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24172024-11-02T04:02:27.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44bd6ed1-8ce7-4be5-b94e-9ac1ab211bc5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24182024-11-02T04:02:27.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44bd6ed1-8ce7-4be5-b94e-9ac1ab211bc5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24192024-11-02T04:02:28.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87883275-577f-475b-b638-a3633eaa5bb1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24202024-11-02T04:02:28.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87883275-577f-475b-b638-a3633eaa5bb1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24212024-11-02T04:02:28.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87883275-577f-475b-b638-a3633eaa5bb1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24222024-11-02T04:02:29.188ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:61995
24232024-11-02T04:02:29.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61995 req_id = 14c05a0f-5037-4025-9e2c-53337c1db1df roles = RoleSet { roles: {} } uri = /metrics/producers
24242024-11-02T04:02:29.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61995 req_id = 14c05a0f-5037-4025-9e2c-53337c1db1df resource = Database result = Ok(()) uri = /metrics/producers
24252024-11-02T04:02:29.196ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 5b8cdd5a-f021-45f2-8323-b6c8f9776060
24262024-11-02T04:02:29.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7889 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61995 req_id = 14c05a0f-5037-4025-9e2c-53337c1db1df response_code = 201 uri = /metrics/producers
24272024-11-02T04:02:29.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f8681aca-17bd-4032-a2f7-33a3376a0be5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24282024-11-02T04:02:29.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f8681aca-17bd-4032-a2f7-33a3376a0be5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24292024-11-02T04:02:29.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f8681aca-17bd-4032-a2f7-33a3376a0be5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24302024-11-02T04:02:30.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 651fb894-94a1-4577-bba8-2badecb3638c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24312024-11-02T04:02:30.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 651fb894-94a1-4577-bba8-2badecb3638c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24322024-11-02T04:02:30.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 651fb894-94a1-4577-bba8-2badecb3638c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24332024-11-02T04:02:31.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a7014ac-3585-4ca1-aba8-e7d6cb01365d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24342024-11-02T04:02:31.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a7014ac-3585-4ca1-aba8-e7d6cb01365d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24352024-11-02T04:02:31.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a7014ac-3585-4ca1-aba8-e7d6cb01365d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24362024-11-02T04:02:32.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1cf72170-3ae5-4716-9d80-472652acda0b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24372024-11-02T04:02:32.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1cf72170-3ae5-4716-9d80-472652acda0b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24382024-11-02T04:02:32.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1cf72170-3ae5-4716-9d80-472652acda0b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24392024-11-02T04:02:33.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
24402024-11-02T04:02:33.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24412024-11-02T04:02:33.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
24422024-11-02T04:02:33.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24432024-11-02T04:02:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24442024-11-02T04:02:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24452024-11-02T04:02:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24462024-11-02T04:02:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24472024-11-02T04:02:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24482024-11-02T04:02:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24492024-11-02T04:02:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24502024-11-02T04:02:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24512024-11-02T04:02:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522024-11-02T04:02:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
24532024-11-02T04:02:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24542024-11-02T04:02:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24552024-11-02T04:02:33.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
24562024-11-02T04:02:33.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.977657ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
24572024-11-02T04:02:33.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24582024-11-02T04:02:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24592024-11-02T04:02:33.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7627f33e-18e0-4f32-a736-5b8b4e68ca64 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24602024-11-02T04:02:33.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7627f33e-18e0-4f32-a736-5b8b4e68ca64 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24612024-11-02T04:02:33.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7627f33e-18e0-4f32-a736-5b8b4e68ca64 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24622024-11-02T04:02:33.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.073946ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24632024-11-02T04:02:34.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79e838bc-16a8-4e63-b65e-dcde3e0fa31c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24642024-11-02T04:02:34.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79e838bc-16a8-4e63-b65e-dcde3e0fa31c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24652024-11-02T04:02:34.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 79e838bc-16a8-4e63-b65e-dcde3e0fa31c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24662024-11-02T04:02:35.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e90e4712-1318-4451-bc9f-52913adb5226 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24672024-11-02T04:02:35.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e90e4712-1318-4451-bc9f-52913adb5226 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24682024-11-02T04:02:35.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e90e4712-1318-4451-bc9f-52913adb5226 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24692024-11-02T04:02:36.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d66c71-0405-4c90-b99f-77e6e72c0ed1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24702024-11-02T04:02:36.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d66c71-0405-4c90-b99f-77e6e72c0ed1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24712024-11-02T04:02:36.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6d66c71-0405-4c90-b99f-77e6e72c0ed1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24722024-11-02T04:02:37.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 982be44b-0081-4ccb-b790-5df9a48bf8b2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24732024-11-02T04:02:37.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 982be44b-0081-4ccb-b790-5df9a48bf8b2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24742024-11-02T04:02:37.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 982be44b-0081-4ccb-b790-5df9a48bf8b2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24752024-11-02T04:02:38.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b4c8447-b7c0-4f1a-9993-ccfdae7486c5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24762024-11-02T04:02:38.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b4c8447-b7c0-4f1a-9993-ccfdae7486c5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24772024-11-02T04:02:38.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b4c8447-b7c0-4f1a-9993-ccfdae7486c5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24782024-11-02T04:02:38.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 3621790a-9457-4cf0-b8b5-7ecd46a2238c response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
24792024-11-02T04:02:39.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d0248ce-87b1-4609-a8fa-bd91d0571758 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24802024-11-02T04:02:39.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d0248ce-87b1-4609-a8fa-bd91d0571758 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24812024-11-02T04:02:39.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d0248ce-87b1-4609-a8fa-bd91d0571758 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24822024-11-02T04:02:40.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99557926-0fd1-4e96-8089-fc397733a5a2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24832024-11-02T04:02:40.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99557926-0fd1-4e96-8089-fc397733a5a2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24842024-11-02T04:02:40.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 99557926-0fd1-4e96-8089-fc397733a5a2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24852024-11-02T04:02:41.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad88b6d4-5445-4f72-87a9-e566c623fcca roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24862024-11-02T04:02:41.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad88b6d4-5445-4f72-87a9-e566c623fcca resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24872024-11-02T04:02:41.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ad88b6d4-5445-4f72-87a9-e566c623fcca response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24882024-11-02T04:02:42.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 958fbe7b-047d-49de-9765-8b1034f1928d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24892024-11-02T04:02:42.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 958fbe7b-047d-49de-9765-8b1034f1928d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24902024-11-02T04:02:42.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 958fbe7b-047d-49de-9765-8b1034f1928d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
24912024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
24922024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
24932024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24942024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
24952024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24962024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24972024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
24982024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
24992024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25002024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25012024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
25022024-11-02T04:02:43.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25032024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
25042024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25052024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
25062024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25072024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
25082024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25092024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
25102024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25112024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25122024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
25132024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25142024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
25152024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
25162024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25172024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25182024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
25192024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.431\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
25202024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
25212024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
25222024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.07\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25232024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
25242024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.231\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
25252024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.13\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25262024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25272024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25282024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25292024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25302024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25312024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25322024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25332024-11-02T04:02:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25342024-11-02T04:02:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25352024-11-02T04:02:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25362024-11-02T04:02:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25372024-11-02T04:02:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25382024-11-02T04:02:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392024-11-02T04:02:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402024-11-02T04:02:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.239479ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25412024-11-02T04:02:43.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422024-11-02T04:02:43.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9667, tv_nsec: 523245592 } })
25432024-11-02T04:02:43.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
25442024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25452024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25462024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25472024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25482024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25492024-11-02T04:02:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25502024-11-02T04:02:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25512024-11-02T04:02:43.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25522024-11-02T04:02:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25532024-11-02T04:02:43.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9667, tv_nsec: 526869629 } })
25542024-11-02T04:02:43.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-11-02T04:02:43.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
25562024-11-02T04:02:43.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25572024-11-02T04:02:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25582024-11-02T04:02:43.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25592024-11-02T04:02:43.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9667, tv_nsec: 530211081 } })
25602024-11-02T04:02:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25612024-11-02T04:02:43.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25622024-11-02T04:02:43.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
25632024-11-02T04:02:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25642024-11-02T04:02:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25652024-11-02T04:02:43.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25662024-11-02T04:02:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25672024-11-02T04:02:43.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25682024-11-02T04:02:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25692024-11-02T04:02:43.557ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25702024-11-02T04:02:43.557ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.368762ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25712024-11-02T04:02:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722024-11-02T04:02:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732024-11-02T04:02:43.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25742024-11-02T04:02:43.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25752024-11-02T04:02:43.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762024-11-02T04:02:43.593ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25772024-11-02T04:02:43.593ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25782024-11-02T04:02:43.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25792024-11-02T04:02:43.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25802024-11-02T04:02:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25812024-11-02T04:02:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25822024-11-02T04:02:43.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25832024-11-02T04:02:43.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25842024-11-02T04:02:43.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25852024-11-02T04:02:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25862024-11-02T04:02:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25872024-11-02T04:02:43.598ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25882024-11-02T04:02:43.598ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25892024-11-02T04:02:43.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25902024-11-02T04:02:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25912024-11-02T04:02:43.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25922024-11-02T04:02:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25932024-11-02T04:02:43.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25942024-11-02T04:02:43.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25952024-11-02T04:02:43.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25962024-11-02T04:02:43.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25972024-11-02T04:02:43.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
25982024-11-02T04:02:43.610ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25992024-11-02T04:02:43.610ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1ea6a28-b4a6-473b-86d0-95ce4de45068", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26002024-11-02T04:02:43.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26012024-11-02T04:02:43.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26022024-11-02T04:02:43.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26032024-11-02T04:02:43.613ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
26042024-11-02T04:02:43.613ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26052024-11-02T04:02:43.613ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f987d42-fc35-4d4d-ae04-f7f984e47c7a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26062024-11-02T04:02:43.613ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26072024-11-02T04:02:43.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26082024-11-02T04:02:43.615ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.499299ms iteration = 15 status = {"physical_disks_added":0}
26092024-11-02T04:02:43.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
26102024-11-02T04:02:43.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26112024-11-02T04:02:43.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26122024-11-02T04:02:43.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.616264ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26132024-11-02T04:02:43.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
26142024-11-02T04:02:43.620ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26152024-11-02T04:02:43.620ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a731576e-cce6-45ce-bf9b-a4d6f723167a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26162024-11-02T04:02:43.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26172024-11-02T04:02:43.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
26182024-11-02T04:02:43.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
26192024-11-02T04:02:43.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.466786ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
26202024-11-02T04:02:43.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.612848ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26212024-11-02T04:02:43.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26222024-11-02T04:02:43.629ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26232024-11-02T04:02:43.629ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26242024-11-02T04:02:43.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.158903ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26252024-11-02T04:02:43.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26262024-11-02T04:02:43.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26272024-11-02T04:02:43.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26282024-11-02T04:02:43.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26292024-11-02T04:02:43.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
26302024-11-02T04:02:43.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26312024-11-02T04:02:43.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26322024-11-02T04:02:43.634ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.531019ms iteration = 12 status = 0
26332024-11-02T04:02:43.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26342024-11-02T04:02:43.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26352024-11-02T04:02:43.718ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26362024-11-02T04:02:43.718ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8656a36-d96d-493c-bb91-db2999596451", "content-length": "1", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26372024-11-02T04:02:43.719ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.095135ms iteration = 12 status = {}
26382024-11-02T04:02:43.720ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26392024-11-02T04:02:43.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26402024-11-02T04:02:43.722ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.812133ms iteration = 12 status = null
26412024-11-02T04:02:43.731ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26422024-11-02T04:02:43.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26432024-11-02T04:02:43.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26442024-11-02T04:02:43.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26452024-11-02T04:02:43.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462024-11-02T04:02:43.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26472024-11-02T04:02:43.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26482024-11-02T04:02:43.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26492024-11-02T04:02:43.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-11-02T04:02:43.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26512024-11-02T04:02:43.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26522024-11-02T04:02:43.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26532024-11-02T04:02:43.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37a51937-f40f-40da-998c-12929b3de7b1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
26542024-11-02T04:02:43.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37a51937-f40f-40da-998c-12929b3de7b1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
26552024-11-02T04:02:43.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea136d62-7070-4f72-a1aa-f710feb829b7", "content-length": "372", "date": "Sat, 02 Nov 2024 04:02:42 GMT"} })
26562024-11-02T04:02:43.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26572024-11-02T04:02:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26582024-11-02T04:02:43.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37a51937-f40f-40da-998c-12929b3de7b1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
26592024-11-02T04:02:43.814ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26602024-11-02T04:02:43.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "db8205c8-be73-4017-a420-dfec54141fe5", "content-length": "691", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26612024-11-02T04:02:43.815ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26622024-11-02T04:02:43.815ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26632024-11-02T04:02:43.815ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26642024-11-02T04:02:43.817ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.004447ms iteration = 12 status = {}
26652024-11-02T04:02:43.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26662024-11-02T04:02:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26672024-11-02T04:02:43.822ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
26682024-11-02T04:02:43.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26692024-11-02T04:02:43.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26702024-11-02T04:02:43.822ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26712024-11-02T04:02:43.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26722024-11-02T04:02:43.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7cba6d57-9f30-48b8-a46b-a4db6e2620c4", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26732024-11-02T04:02:43.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26742024-11-02T04:02:43.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26752024-11-02T04:02:43.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26762024-11-02T04:02:43.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26772024-11-02T04:02:43.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26782024-11-02T04:02:43.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26792024-11-02T04:02:43.830ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26802024-11-02T04:02:43.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26812024-11-02T04:02:43.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7bc30acd-61cc-4afd-9d80-029275e52231", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26822024-11-02T04:02:43.831ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26832024-11-02T04:02:43.832ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da76d9f-04a8-43b5-969a-5f418996571d", "content-length": "134", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
26842024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26852024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
26862024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26872024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26882024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26892024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26902024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26912024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26922024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26932024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26942024-11-02T04:02:43.832ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
26952024-11-02T04:02:43.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26962024-11-02T04:02:43.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26972024-11-02T04:02:43.832ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.550152ms iteration = 13 status = {}
26982024-11-02T04:02:43.834ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26992024-11-02T04:02:43.838ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b925e8-8dd1-4b78-b19a-45ebce43fa8c", "content-length": "2", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
27002024-11-02T04:02:43.838ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27012024-11-02T04:02:43.838ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b376f838-75fc-421e-bd80-f64e3d6efdb2", "content-length": "52", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
27022024-11-02T04:02:43.838ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
27032024-11-02T04:02:43.838ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27042024-11-02T04:02:43.935ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1a8824f5-9ed5-4c67-8818-64a9f2b5b69a", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
27052024-11-02T04:02:43.935ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
27062024-11-02T04:02:43.935ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27072024-11-02T04:02:43.935ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ffd6087-2882-4b3b-b86f-30fa76f80cc2", "content-length": "682", "date": "Sat, 02 Nov 2024 04:02:43 GMT"} })
27082024-11-02T04:02:43.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27092024-11-02T04:02:43.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27102024-11-02T04:02:43.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27112024-11-02T04:02:43.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27122024-11-02T04:02:43.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27132024-11-02T04:02:43.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27142024-11-02T04:02:43.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27152024-11-02T04:02:43.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27162024-11-02T04:02:43.952ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 410.942696ms iteration = 12 status = {}
27172024-11-02T04:02:44.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a57a83d0-a0ef-499b-8360-ebfcd692d140 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27182024-11-02T04:02:44.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a57a83d0-a0ef-499b-8360-ebfcd692d140 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27192024-11-02T04:02:44.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a57a83d0-a0ef-499b-8360-ebfcd692d140 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27202024-11-02T04:02:44.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 80287871-4298-472c-8ad8-87a5e8b84038 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27212024-11-02T04:02:44.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 80287871-4298-472c-8ad8-87a5e8b84038 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27222024-11-02T04:02:44.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 80287871-4298-472c-8ad8-87a5e8b84038 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27232024-11-02T04:02:45.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc906391-ea5a-400c-be58-ffc9adead4cc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27242024-11-02T04:02:45.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc906391-ea5a-400c-be58-ffc9adead4cc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27252024-11-02T04:02:45.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc906391-ea5a-400c-be58-ffc9adead4cc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27262024-11-02T04:02:46.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f68ab9c3-1da9-4901-9457-d12f4105a6c6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27272024-11-02T04:02:46.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f68ab9c3-1da9-4901-9457-d12f4105a6c6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27282024-11-02T04:02:46.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f68ab9c3-1da9-4901-9457-d12f4105a6c6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27292024-11-02T04:02:47.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b27c967-2ebe-4b3b-b1c2-73390010e56e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27302024-11-02T04:02:47.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b27c967-2ebe-4b3b-b1c2-73390010e56e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27312024-11-02T04:02:47.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b27c967-2ebe-4b3b-b1c2-73390010e56e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27322024-11-02T04:02:48.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7504c144-4784-4b64-a4af-ff65e604c72f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27332024-11-02T04:02:48.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7504c144-4784-4b64-a4af-ff65e604c72f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27342024-11-02T04:02:48.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7504c144-4784-4b64-a4af-ff65e604c72f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27352024-11-02T04:02:49.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83f47487-eed9-481d-8f4b-2af35b9064d2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27362024-11-02T04:02:49.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83f47487-eed9-481d-8f4b-2af35b9064d2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27372024-11-02T04:02:49.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83f47487-eed9-481d-8f4b-2af35b9064d2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27382024-11-02T04:02:50.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e68ac97-3b44-45b6-bd71-35f99d11b3cf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27392024-11-02T04:02:50.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e68ac97-3b44-45b6-bd71-35f99d11b3cf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27402024-11-02T04:02:50.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e68ac97-3b44-45b6-bd71-35f99d11b3cf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27412024-11-02T04:02:51.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = feea43c6-07bd-4499-ac17-041f52367469 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27422024-11-02T04:02:51.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = feea43c6-07bd-4499-ac17-041f52367469 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27432024-11-02T04:02:51.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = feea43c6-07bd-4499-ac17-041f52367469 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27442024-11-02T04:02:53.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 01186442-5f33-4937-beb8-9708f584a079 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27452024-11-02T04:02:53.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 01186442-5f33-4937-beb8-9708f584a079 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27462024-11-02T04:02:53.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 01186442-5f33-4937-beb8-9708f584a079 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27472024-11-02T04:02:53.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
27482024-11-02T04:02:53.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27492024-11-02T04:02:53.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
27502024-11-02T04:02:53.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27512024-11-02T04:02:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27522024-11-02T04:02:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27532024-11-02T04:02:53.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27542024-11-02T04:02:53.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27552024-11-02T04:02:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27562024-11-02T04:02:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27572024-11-02T04:02:53.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27582024-11-02T04:02:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27592024-11-02T04:02:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27602024-11-02T04:02:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27612024-11-02T04:02:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622024-11-02T04:02:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
27632024-11-02T04:02:53.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27642024-11-02T04:02:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27652024-11-02T04:02:53.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
27662024-11-02T04:02:53.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.929177ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
27672024-11-02T04:02:53.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.587483ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27682024-11-02T04:02:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1358 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = a075c429-94b6-46fc-87eb-ab1c28296480 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
27692024-11-02T04:02:54.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89bf2dca-64e4-428b-9844-6abb9312bd3c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27702024-11-02T04:02:54.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89bf2dca-64e4-428b-9844-6abb9312bd3c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27712024-11-02T04:02:54.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89bf2dca-64e4-428b-9844-6abb9312bd3c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27722024-11-02T04:02:55.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 721cb90a-901d-4fd1-94b0-a36cb00dbde5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27732024-11-02T04:02:55.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 721cb90a-901d-4fd1-94b0-a36cb00dbde5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27742024-11-02T04:02:55.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 721cb90a-901d-4fd1-94b0-a36cb00dbde5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27752024-11-02T04:02:56.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2eb4146b-6adf-418b-99da-abd9c93c05a8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27762024-11-02T04:02:56.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2eb4146b-6adf-418b-99da-abd9c93c05a8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27772024-11-02T04:02:56.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2eb4146b-6adf-418b-99da-abd9c93c05a8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27782024-11-02T04:02:57.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7770af-e4fc-41b8-9339-ea26be5dbc7a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27792024-11-02T04:02:57.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7770af-e4fc-41b8-9339-ea26be5dbc7a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27802024-11-02T04:02:57.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7770af-e4fc-41b8-9339-ea26be5dbc7a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27812024-11-02T04:02:57.461ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27822024-11-02T04:02:57.461ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
27832024-11-02T04:02:57.491ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
27842024-11-02T04:02:57.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39850
27852024-11-02T04:02:57.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39850 req_id = 364a87fb-a894-47ed-9b10-0a527f569429 roles = RoleSet { roles: {} } uri = /metrics/producers
27862024-11-02T04:02:57.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39850 req_id = 364a87fb-a894-47ed-9b10-0a527f569429 resource = Database result = Ok(()) uri = /metrics/producers
27872024-11-02T04:02:57.509ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
27882024-11-02T04:02:57.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 17449 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39850 req_id = 364a87fb-a894-47ed-9b10-0a527f569429 response_code = 201 uri = /metrics/producers
27892024-11-02T04:02:57.509ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "364a87fb-a894-47ed-9b10-0a527f569429", "content-length": "41", "date": "Sat, 02 Nov 2024 04:02:57 GMT"} })
27902024-11-02T04:02:57.511ZDEBGnexus (producer-registration-task): registered with nexus successfully
27912024-11-02T04:02:57.511ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27922024-11-02T04:02:58.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8efcd70a-d0d6-4e99-adaf-3de28f07df67 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27932024-11-02T04:02:58.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8efcd70a-d0d6-4e99-adaf-3de28f07df67 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27942024-11-02T04:02:58.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8efcd70a-d0d6-4e99-adaf-3de28f07df67 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27952024-11-02T04:02:59.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ccc6f07b-0044-49bc-97a1-a6902f2bd2c6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27962024-11-02T04:02:59.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ccc6f07b-0044-49bc-97a1-a6902f2bd2c6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27972024-11-02T04:02:59.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ccc6f07b-0044-49bc-97a1-a6902f2bd2c6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27982024-11-02T04:03:00.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a54a9b-d673-4a44-82ae-c48f12cdebe5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
27992024-11-02T04:03:00.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a54a9b-d673-4a44-82ae-c48f12cdebe5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28002024-11-02T04:03:00.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a54a9b-d673-4a44-82ae-c48f12cdebe5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28012024-11-02T04:03:01.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a6ba70a0-3358-41d7-b67a-637458afffd6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28022024-11-02T04:03:01.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a6ba70a0-3358-41d7-b67a-637458afffd6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28032024-11-02T04:03:01.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a6ba70a0-3358-41d7-b67a-637458afffd6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28042024-11-02T04:03:02.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7698eac-f59b-4a3d-a77f-59e40439dc99 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28052024-11-02T04:03:02.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7698eac-f59b-4a3d-a77f-59e40439dc99 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28062024-11-02T04:03:02.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7698eac-f59b-4a3d-a77f-59e40439dc99 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28072024-11-02T04:03:03.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fc6a9125-af53-4608-98bd-caa97998e4f8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28082024-11-02T04:03:03.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fc6a9125-af53-4608-98bd-caa97998e4f8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28092024-11-02T04:03:03.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fc6a9125-af53-4608-98bd-caa97998e4f8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28102024-11-02T04:03:03.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
28112024-11-02T04:03:03.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28122024-11-02T04:03:03.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
28132024-11-02T04:03:03.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28142024-11-02T04:03:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28152024-11-02T04:03:03.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28162024-11-02T04:03:03.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28172024-11-02T04:03:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28182024-11-02T04:03:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28192024-11-02T04:03:03.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.72972ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28202024-11-02T04:03:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28212024-11-02T04:03:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222024-11-02T04:03:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232024-11-02T04:03:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28242024-11-02T04:03:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28252024-11-02T04:03:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28262024-11-02T04:03:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
28272024-11-02T04:03:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28282024-11-02T04:03:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28292024-11-02T04:03:03.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
28302024-11-02T04:03:03.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.369122ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
28312024-11-02T04:03:04.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6db6565f-83f3-4204-80e8-e745a9b3c7b9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28322024-11-02T04:03:04.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6db6565f-83f3-4204-80e8-e745a9b3c7b9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28332024-11-02T04:03:04.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6db6565f-83f3-4204-80e8-e745a9b3c7b9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28342024-11-02T04:03:05.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cc853dd-24f1-4025-b559-1eaad6246dbf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28352024-11-02T04:03:05.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cc853dd-24f1-4025-b559-1eaad6246dbf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28362024-11-02T04:03:05.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cc853dd-24f1-4025-b559-1eaad6246dbf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28372024-11-02T04:03:06.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d291f238-eabc-42c3-8d4c-5977cf40e000 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28382024-11-02T04:03:06.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d291f238-eabc-42c3-8d4c-5977cf40e000 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28392024-11-02T04:03:06.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d291f238-eabc-42c3-8d4c-5977cf40e000 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28402024-11-02T04:03:07.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c1fbef9c-a996-4d69-87e8-770cfe79354a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28412024-11-02T04:03:07.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c1fbef9c-a996-4d69-87e8-770cfe79354a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28422024-11-02T04:03:07.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c1fbef9c-a996-4d69-87e8-770cfe79354a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28432024-11-02T04:03:08.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bf88669a-c513-43d6-9ac0-3cfad09386f1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28442024-11-02T04:03:08.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bf88669a-c513-43d6-9ac0-3cfad09386f1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28452024-11-02T04:03:08.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bf88669a-c513-43d6-9ac0-3cfad09386f1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28462024-11-02T04:03:08.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1403 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = c8b9348b-8796-4473-b9f2-cc8fc6e5dee7 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
28472024-11-02T04:03:09.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc0277d5-71c8-4da5-99fa-3034f08af27d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28482024-11-02T04:03:09.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc0277d5-71c8-4da5-99fa-3034f08af27d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28492024-11-02T04:03:09.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc0277d5-71c8-4da5-99fa-3034f08af27d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28502024-11-02T04:03:10.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ee95e12-a401-4f7c-a006-400ac4567ba9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28512024-11-02T04:03:10.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ee95e12-a401-4f7c-a006-400ac4567ba9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28522024-11-02T04:03:10.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ee95e12-a401-4f7c-a006-400ac4567ba9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28532024-11-02T04:03:11.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 291b2014-d751-462e-8096-b38d9ec99c5b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28542024-11-02T04:03:11.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 291b2014-d751-462e-8096-b38d9ec99c5b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28552024-11-02T04:03:11.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 291b2014-d751-462e-8096-b38d9ec99c5b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28562024-11-02T04:03:12.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92fab72-d1c3-45f5-bc9e-69beace4992c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28572024-11-02T04:03:12.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92fab72-d1c3-45f5-bc9e-69beace4992c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28582024-11-02T04:03:12.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e92fab72-d1c3-45f5-bc9e-69beace4992c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28592024-11-02T04:03:13.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 238c6256-5d5e-414b-86cc-b9ac136201f2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28602024-11-02T04:03:13.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 238c6256-5d5e-414b-86cc-b9ac136201f2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28612024-11-02T04:03:13.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 238c6256-5d5e-414b-86cc-b9ac136201f2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
28622024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
28632024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
28642024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28652024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28662024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
28672024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
28682024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28692024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28702024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
28712024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28722024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
28732024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28742024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
28752024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28762024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28772024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
28782024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28792024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28802024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
28812024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
28822024-11-02T04:03:13.541ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
28832024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28842024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.531\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
28852024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
28862024-11-02T04:03:13.541ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:53:13.541411648 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28872024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
28882024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28892024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
28902024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28912024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
28922024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28932024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28942024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
28952024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
28962024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28972024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
28982024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
28992024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29002024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
29012024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
29022024-11-02T04:03:13.541ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29032024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
29042024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29052024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
29062024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29072024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29082024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
29092024-11-02T04:03:13.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29102024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29112024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
29122024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
29132024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29142024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
29152024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.281\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
29162024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
29172024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
29182024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
29192024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29202024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.19\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29212024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
29222024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29232024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.49\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
29242024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
29252024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.471\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29262024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29272024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29282024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29292024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29302024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29312024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29322024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29332024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29342024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29352024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29362024-11-02T04:03:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29372024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
29382024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29392024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29402024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29412024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29422024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29432024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29442024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29452024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29462024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29472024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29482024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29492024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29502024-11-02T04:03:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9697, tv_nsec: 519534842 } })
29512024-11-02T04:03:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9697, tv_nsec: 519562083 } })
29522024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29532024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29542024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29552024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29562024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
29572024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.232857ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
29582024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
29592024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.263558ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
29602024-11-02T04:03:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29612024-11-02T04:03:13.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9697, tv_nsec: 521527895 } })
29622024-11-02T04:03:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29632024-11-02T04:03:13.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
29642024-11-02T04:03:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29652024-11-02T04:03:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29662024-11-02T04:03:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29672024-11-02T04:03:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29682024-11-02T04:03:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.20255ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29692024-11-02T04:03:13.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702024-11-02T04:03:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29712024-11-02T04:03:13.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29722024-11-02T04:03:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29732024-11-02T04:03:13.547ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29742024-11-02T04:03:13.547ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29752024-11-02T04:03:13.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29762024-11-02T04:03:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29772024-11-02T04:03:13.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29782024-11-02T04:03:13.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9697, tv_nsec: 526933931 } })
29792024-11-02T04:03:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29802024-11-02T04:03:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
29812024-11-02T04:03:13.549ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29822024-11-02T04:03:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29832024-11-02T04:03:13.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
29842024-11-02T04:03:13.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-11-02T04:03:13.551ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:53:13.541411648 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29862024-11-02T04:03:13.551ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.478025ms iteration = 7 status = {"expiration":"2024-11-02T03:53:13.541411648Z","pruned":[]}
29872024-11-02T04:03:13.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29882024-11-02T04:03:13.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29892024-11-02T04:03:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29902024-11-02T04:03:13.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912024-11-02T04:03:13.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-11-02T04:03:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29932024-11-02T04:03:13.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29942024-11-02T04:03:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29952024-11-02T04:03:13.555ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.769776ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
29962024-11-02T04:03:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29972024-11-02T04:03:13.556ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29982024-11-02T04:03:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29992024-11-02T04:03:13.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002024-11-02T04:03:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30012024-11-02T04:03:13.561ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30022024-11-02T04:03:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30032024-11-02T04:03:13.568ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30042024-11-02T04:03:13.568ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30052024-11-02T04:03:13.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30062024-11-02T04:03:13.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9697, tv_nsec: 546421629 } })
30072024-11-02T04:03:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30082024-11-02T04:03:13.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30092024-11-02T04:03:13.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
30102024-11-02T04:03:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30112024-11-02T04:03:13.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122024-11-02T04:03:13.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132024-11-02T04:03:13.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30142024-11-02T04:03:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30152024-11-02T04:03:13.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30162024-11-02T04:03:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30172024-11-02T04:03:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30182024-11-02T04:03:13.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30192024-11-02T04:03:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30202024-11-02T04:03:13.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30212024-11-02T04:03:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30222024-11-02T04:03:13.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30232024-11-02T04:03:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30242024-11-02T04:03:13.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30252024-11-02T04:03:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30282024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.486991ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30292024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30302024-11-02T04:03:13.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30312024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.182134ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30322024-11-02T04:03:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30332024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.43726ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30342024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30352024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30362024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30372024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30382024-11-02T04:03:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30392024-11-02T04:03:13.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30402024-11-02T04:03:13.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30412024-11-02T04:03:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30422024-11-02T04:03:13.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432024-11-02T04:03:13.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30442024-11-02T04:03:13.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30452024-11-02T04:03:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30462024-11-02T04:03:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30472024-11-02T04:03:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30482024-11-02T04:03:13.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30492024-11-02T04:03:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30502024-11-02T04:03:13.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30512024-11-02T04:03:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30522024-11-02T04:03:13.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30532024-11-02T04:03:13.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30542024-11-02T04:03:13.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552024-11-02T04:03:13.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30562024-11-02T04:03:13.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30572024-11-02T04:03:13.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30582024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30592024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30602024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30612024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30622024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
30632024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30642024-11-02T04:03:13.622ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30652024-11-02T04:03:13.622ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30662024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.604763ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30672024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30682024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30692024-11-02T04:03:13.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30702024-11-02T04:03:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30712024-11-02T04:03:13.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30722024-11-02T04:03:13.623ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30732024-11-02T04:03:13.623ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.090583ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30742024-11-02T04:03:13.624ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30752024-11-02T04:03:13.624ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30762024-11-02T04:03:13.624ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.680676ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30772024-11-02T04:03:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30782024-11-02T04:03:13.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30792024-11-02T04:03:13.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30802024-11-02T04:03:13.627ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 86.341744ms iteration = 4 status = {"nsuccess":5}
30812024-11-02T04:03:13.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30822024-11-02T04:03:13.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30832024-11-02T04:03:13.640ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
30842024-11-02T04:03:13.640ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.1577ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
30852024-11-02T04:03:13.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30862024-11-02T04:03:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30872024-11-02T04:03:13.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30882024-11-02T04:03:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30892024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30902024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30912024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30922024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30932024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30942024-11-02T04:03:13.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952024-11-02T04:03:13.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30962024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30972024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30982024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
30992024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31002024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31012024-11-02T04:03:13.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31022024-11-02T04:03:13.658ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.224857ms iteration = 13 status = 0
31032024-11-02T04:03:13.661ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31042024-11-02T04:03:13.661ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31052024-11-02T04:03:13.661ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31062024-11-02T04:03:13.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31072024-11-02T04:03:13.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31082024-11-02T04:03:13.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31092024-11-02T04:03:13.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31102024-11-02T04:03:13.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-11-02T04:03:13.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31122024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31132024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31142024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31152024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31162024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31172024-11-02T04:03:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31182024-11-02T04:03:13.671ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31192024-11-02T04:03:13.671ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31202024-11-02T04:03:13.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31212024-11-02T04:03:13.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31222024-11-02T04:03:13.694ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31232024-11-02T04:03:13.694ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
31242024-11-02T04:03:13.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31252024-11-02T04:03:13.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31262024-11-02T04:03:13.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31272024-11-02T04:03:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31282024-11-02T04:03:13.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31292024-11-02T04:03:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31302024-11-02T04:03:13.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31312024-11-02T04:03:13.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31322024-11-02T04:03:13.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31332024-11-02T04:03:13.702ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
31342024-11-02T04:03:13.702ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31352024-11-02T04:03:13.702ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
31362024-11-02T04:03:13.702ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 161.292064ms iteration = 8 status = {"generation":2}
31372024-11-02T04:03:13.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31382024-11-02T04:03:13.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31392024-11-02T04:03:13.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31402024-11-02T04:03:13.712ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
31412024-11-02T04:03:13.712ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 171.470883ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31422024-11-02T04:03:13.734ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.050386ms iteration = 16 status = {"physical_disks_added":0}
31432024-11-02T04:03:13.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31442024-11-02T04:03:13.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31452024-11-02T04:03:13.743ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31462024-11-02T04:03:13.743ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31472024-11-02T04:03:13.744ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b2cee2-a154-477a-bf10-a9fb195a6ec2", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:12 GMT"} })
31482024-11-02T04:03:13.744ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31492024-11-02T04:03:13.746ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31502024-11-02T04:03:13.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
31512024-11-02T04:03:13.749ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31522024-11-02T04:03:13.749ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31012ae4-f399-4ebd-9599-b9d0693da8bb", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:12 GMT"} })
31532024-11-02T04:03:13.749ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31542024-11-02T04:03:13.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
31552024-11-02T04:03:13.753ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31562024-11-02T04:03:13.753ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 211.702076ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31572024-11-02T04:03:13.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31582024-11-02T04:03:13.755ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31592024-11-02T04:03:13.755ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc2cac8-75b0-488d-a061-9d669430ecc2", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:12 GMT"} })
31602024-11-02T04:03:13.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31612024-11-02T04:03:13.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31622024-11-02T04:03:13.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31632024-11-02T04:03:13.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31642024-11-02T04:03:13.873ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31652024-11-02T04:03:13.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31662024-11-02T04:03:13.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef0f0da9-09a7-42d9-b348-40b51a5bf2f1", "content-length": "372", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
31672024-11-02T04:03:13.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31682024-11-02T04:03:13.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31692024-11-02T04:03:13.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31702024-11-02T04:03:13.876ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31712024-11-02T04:03:13.876ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31722024-11-02T04:03:13.876ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
31732024-11-02T04:03:13.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 335.037055ms iteration = 8 status = {"generation":1}
31742024-11-02T04:03:13.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31752024-11-02T04:03:13.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31762024-11-02T04:03:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31772024-11-02T04:03:13.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782024-11-02T04:03:13.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31792024-11-02T04:03:13.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31802024-11-02T04:03:13.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31812024-11-02T04:03:13.915ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31822024-11-02T04:03:13.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31832024-11-02T04:03:13.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cbe61aff-b754-4490-9a0e-c0b8fb3fb059", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
31842024-11-02T04:03:13.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31852024-11-02T04:03:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31862024-11-02T04:03:13.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31872024-11-02T04:03:13.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31882024-11-02T04:03:13.920ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 379.208994ms iteration = 13 status = {}
31892024-11-02T04:03:13.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31902024-11-02T04:03:13.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31912024-11-02T04:03:13.924ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31922024-11-02T04:03:13.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31932024-11-02T04:03:13.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d7344fc1-950f-47a0-97f4-289cee5b354b", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
31942024-11-02T04:03:13.927ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.163033ms iteration = 14 status = {}
31952024-11-02T04:03:13.930ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31962024-11-02T04:03:13.931ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ab01bd5-f041-4cc3-a837-7f18c944bbf8", "content-length": "1", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
31972024-11-02T04:03:13.932ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31982024-11-02T04:03:13.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31992024-11-02T04:03:13.934ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.595173ms iteration = 13 status = null
32002024-11-02T04:03:14.014ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32012024-11-02T04:03:14.037ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c3c4087-8af6-40f7-9e2c-3c05e003a6e9", "content-length": "691", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
32022024-11-02T04:03:14.037ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32032024-11-02T04:03:14.037ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32042024-11-02T04:03:14.037ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32052024-11-02T04:03:14.039ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 497.581966ms iteration = 13 status = {}
32062024-11-02T04:03:14.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32072024-11-02T04:03:14.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bd775c29-cdcc-4e1a-ab6e-2131f87b36c2", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32082024-11-02T04:03:14.067ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32092024-11-02T04:03:14.069ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c368e8c7-9bca-4574-abe8-d9ab96ad4552", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32102024-11-02T04:03:14.069ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32112024-11-02T04:03:14.071ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32122024-11-02T04:03:14.071ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 529.761727ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32132024-11-02T04:03:14.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32142024-11-02T04:03:14.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32152024-11-02T04:03:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32162024-11-02T04:03:14.123ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
32172024-11-02T04:03:14.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32182024-11-02T04:03:14.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32192024-11-02T04:03:14.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32202024-11-02T04:03:14.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a9dd7e53-0c4d-4e76-8bbd-59f833af633e", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32212024-11-02T04:03:14.127ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32222024-11-02T04:03:14.129ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bf917a67-a123-4301-bb6e-ed7190b46cd1", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32232024-11-02T04:03:14.129ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32242024-11-02T04:03:14.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 89ac4d38-2a99-4153-815f-02a818b36e05 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32252024-11-02T04:03:14.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 89ac4d38-2a99-4153-815f-02a818b36e05 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32262024-11-02T04:03:14.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32272024-11-02T04:03:14.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eda1bf2-98e4-4f4c-a46c-cd83ec76cdc7", "content-length": "134", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} })
32282024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32292024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
32302024-11-02T04:03:14.131ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "09fe973b-75a3-4a10-9409-dda19ccf4eae", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32312024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32322024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32332024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32342024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32352024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32362024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32372024-11-02T04:03:14.131ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32382024-11-02T04:03:14.132ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32392024-11-02T04:03:14.132ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32402024-11-02T04:03:14.132ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
32412024-11-02T04:03:14.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32422024-11-02T04:03:14.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32432024-11-02T04:03:14.133ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32442024-11-02T04:03:14.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 89ac4d38-2a99-4153-815f-02a818b36e05 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32452024-11-02T04:03:14.133ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 592.235308ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32462024-11-02T04:03:14.134ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32472024-11-02T04:03:14.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d0f65b5-13ef-40d5-bd09-9627623b6229", "content-length": "2", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} })
32482024-11-02T04:03:14.134ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32492024-11-02T04:03:14.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "378d7c01-8277-48a4-b8a4-28bf959d8218", "content-length": "52", "date": "Sat, 02 Nov 2024 04:03:14 GMT"} })
32502024-11-02T04:03:14.135ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
32512024-11-02T04:03:14.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32522024-11-02T04:03:14.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a78ed93-4279-4082-b8c0-a0315b3e38f8", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
32532024-11-02T04:03:14.224ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
32542024-11-02T04:03:14.224ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32552024-11-02T04:03:14.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "538427eb-5686-4df2-9366-f60f0790eb26", "content-length": "682", "date": "Sat, 02 Nov 2024 04:03:13 GMT"} })
32562024-11-02T04:03:14.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32572024-11-02T04:03:14.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32582024-11-02T04:03:14.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32592024-11-02T04:03:14.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32602024-11-02T04:03:14.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32612024-11-02T04:03:14.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32622024-11-02T04:03:14.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32632024-11-02T04:03:14.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32642024-11-02T04:03:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.592644ms iteration = 13 status = {}
32652024-11-02T04:03:14.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7a0854a0-739f-4b76-b4c8-b3074780e611 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32662024-11-02T04:03:14.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7a0854a0-739f-4b76-b4c8-b3074780e611 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32672024-11-02T04:03:14.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7a0854a0-739f-4b76-b4c8-b3074780e611 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32682024-11-02T04:03:15.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c8ea324-db2f-4a40-8927-244de28b350b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32692024-11-02T04:03:15.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c8ea324-db2f-4a40-8927-244de28b350b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32702024-11-02T04:03:15.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c8ea324-db2f-4a40-8927-244de28b350b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32712024-11-02T04:03:16.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7dfe5b32-643c-4c83-b88f-e64359d95914 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32722024-11-02T04:03:16.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7dfe5b32-643c-4c83-b88f-e64359d95914 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32732024-11-02T04:03:16.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7dfe5b32-643c-4c83-b88f-e64359d95914 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32742024-11-02T04:03:17.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43b35827-d032-4f58-9bd7-a204b4a51c54 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32752024-11-02T04:03:17.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43b35827-d032-4f58-9bd7-a204b4a51c54 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32762024-11-02T04:03:17.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43b35827-d032-4f58-9bd7-a204b4a51c54 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32772024-11-02T04:03:18.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ad8e8fe-f9af-41a9-893a-a07a0d9e75f0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32782024-11-02T04:03:18.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ad8e8fe-f9af-41a9-893a-a07a0d9e75f0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32792024-11-02T04:03:18.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ad8e8fe-f9af-41a9-893a-a07a0d9e75f0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32802024-11-02T04:03:19.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0bf4ee1-f2d4-4fe7-9c14-9961f066aee2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32812024-11-02T04:03:19.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0bf4ee1-f2d4-4fe7-9c14-9961f066aee2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32822024-11-02T04:03:19.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0bf4ee1-f2d4-4fe7-9c14-9961f066aee2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32832024-11-02T04:03:20.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9280a5ef-6bf4-44da-99e9-997a7dd448c2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32842024-11-02T04:03:20.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9280a5ef-6bf4-44da-99e9-997a7dd448c2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32852024-11-02T04:03:20.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9280a5ef-6bf4-44da-99e9-997a7dd448c2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32862024-11-02T04:03:21.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aaba4161-2b30-42e2-af3c-30436a962cf2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32872024-11-02T04:03:21.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aaba4161-2b30-42e2-af3c-30436a962cf2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32882024-11-02T04:03:21.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aaba4161-2b30-42e2-af3c-30436a962cf2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32892024-11-02T04:03:22.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6380adbb-bb78-47db-a823-4bac467879dc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32902024-11-02T04:03:22.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6380adbb-bb78-47db-a823-4bac467879dc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32912024-11-02T04:03:22.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6380adbb-bb78-47db-a823-4bac467879dc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
32922024-11-02T04:03:23.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
32932024-11-02T04:03:23.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
32942024-11-02T04:03:23.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32952024-11-02T04:03:23.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32962024-11-02T04:03:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32972024-11-02T04:03:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32982024-11-02T04:03:23.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32992024-11-02T04:03:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33002024-11-02T04:03:23.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33012024-11-02T04:03:23.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.572447ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33022024-11-02T04:03:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33032024-11-02T04:03:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33042024-11-02T04:03:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33052024-11-02T04:03:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33062024-11-02T04:03:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33072024-11-02T04:03:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-11-02T04:03:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
33092024-11-02T04:03:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33102024-11-02T04:03:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33112024-11-02T04:03:23.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
33122024-11-02T04:03:23.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.297925ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
33132024-11-02T04:03:23.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 812b9d3c-83a2-4a21-9e53-c685c6d34ad8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33142024-11-02T04:03:23.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 812b9d3c-83a2-4a21-9e53-c685c6d34ad8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33152024-11-02T04:03:23.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 812b9d3c-83a2-4a21-9e53-c685c6d34ad8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33162024-11-02T04:03:23.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1436 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 488efdc1-566b-4cae-a21d-a326e07f4307 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
33172024-11-02T04:03:24.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8e01c94-e72a-4e18-9914-0c39e111fa13 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33182024-11-02T04:03:24.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8e01c94-e72a-4e18-9914-0c39e111fa13 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33192024-11-02T04:03:24.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8e01c94-e72a-4e18-9914-0c39e111fa13 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33202024-11-02T04:03:25.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 25f58347-9a04-48d7-8672-7550f093a8d2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33212024-11-02T04:03:25.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 25f58347-9a04-48d7-8672-7550f093a8d2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33222024-11-02T04:03:25.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 25f58347-9a04-48d7-8672-7550f093a8d2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33232024-11-02T04:03:26.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6975bb8c-50df-452e-be49-d7f7fb931363 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33242024-11-02T04:03:26.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6975bb8c-50df-452e-be49-d7f7fb931363 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33252024-11-02T04:03:26.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6975bb8c-50df-452e-be49-d7f7fb931363 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33262024-11-02T04:03:27.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6669d80f-724c-45b8-8838-93209bf38933 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33272024-11-02T04:03:27.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6669d80f-724c-45b8-8838-93209bf38933 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33282024-11-02T04:03:27.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6669d80f-724c-45b8-8838-93209bf38933 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33292024-11-02T04:03:28.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d67c0a75-28d0-4252-befc-20745bb37f44 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33302024-11-02T04:03:28.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d67c0a75-28d0-4252-befc-20745bb37f44 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33312024-11-02T04:03:28.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d67c0a75-28d0-4252-befc-20745bb37f44 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33322024-11-02T04:03:29.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8e93492-8599-4414-9c72-ab91000a91b3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33332024-11-02T04:03:29.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8e93492-8599-4414-9c72-ab91000a91b3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33342024-11-02T04:03:29.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8e93492-8599-4414-9c72-ab91000a91b3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33352024-11-02T04:03:30.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8754d453-8fbf-4617-9701-62be8e1476e6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33362024-11-02T04:03:30.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8754d453-8fbf-4617-9701-62be8e1476e6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33372024-11-02T04:03:30.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8754d453-8fbf-4617-9701-62be8e1476e6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33382024-11-02T04:03:31.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8d4a67-aac0-4d4c-9949-1da1ea56d659 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33392024-11-02T04:03:31.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8d4a67-aac0-4d4c-9949-1da1ea56d659 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33402024-11-02T04:03:31.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8d4a67-aac0-4d4c-9949-1da1ea56d659 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33412024-11-02T04:03:32.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c3d3e3b-9ee7-42f2-bd99-52ad65a22435 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33422024-11-02T04:03:32.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c3d3e3b-9ee7-42f2-bd99-52ad65a22435 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33432024-11-02T04:03:32.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7c3d3e3b-9ee7-42f2-bd99-52ad65a22435 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33442024-11-02T04:03:33.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
33452024-11-02T04:03:33.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33462024-11-02T04:03:33.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
33472024-11-02T04:03:33.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33482024-11-02T04:03:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33492024-11-02T04:03:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33502024-11-02T04:03:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33512024-11-02T04:03:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33522024-11-02T04:03:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33532024-11-02T04:03:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33542024-11-02T04:03:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33552024-11-02T04:03:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33562024-11-02T04:03:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33572024-11-02T04:03:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
33582024-11-02T04:03:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33592024-11-02T04:03:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33602024-11-02T04:03:33.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
33612024-11-02T04:03:33.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.947374ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
33622024-11-02T04:03:33.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33632024-11-02T04:03:33.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33642024-11-02T04:03:33.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.969206ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33652024-11-02T04:03:33.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 026d4ce9-4237-4052-ab9e-5dab0173a6f9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33662024-11-02T04:03:33.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 026d4ce9-4237-4052-ab9e-5dab0173a6f9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33672024-11-02T04:03:33.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 026d4ce9-4237-4052-ab9e-5dab0173a6f9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33682024-11-02T04:03:34.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 84d0b669-cdf2-412e-9687-e2dea08e3e3b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33692024-11-02T04:03:34.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 84d0b669-cdf2-412e-9687-e2dea08e3e3b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33702024-11-02T04:03:34.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 84d0b669-cdf2-412e-9687-e2dea08e3e3b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33712024-11-02T04:03:35.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f93eaf1c-c08a-4b51-9245-0db6b56d63b1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33722024-11-02T04:03:35.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f93eaf1c-c08a-4b51-9245-0db6b56d63b1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33732024-11-02T04:03:35.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f93eaf1c-c08a-4b51-9245-0db6b56d63b1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33742024-11-02T04:03:36.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d1304acc-cae1-4eef-b230-879d3c30e221 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33752024-11-02T04:03:36.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d1304acc-cae1-4eef-b230-879d3c30e221 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33762024-11-02T04:03:36.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d1304acc-cae1-4eef-b230-879d3c30e221 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33772024-11-02T04:03:38.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e55aa3e2-9363-4013-bd9a-2a4f51b45960 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33782024-11-02T04:03:38.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e55aa3e2-9363-4013-bd9a-2a4f51b45960 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33792024-11-02T04:03:38.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e55aa3e2-9363-4013-bd9a-2a4f51b45960 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33802024-11-02T04:03:38.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 66be9793-9ac2-435f-b5e4-3461f2463b34 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
33812024-11-02T04:03:39.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c352517-1577-4a9d-887e-4009262feb85 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33822024-11-02T04:03:39.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c352517-1577-4a9d-887e-4009262feb85 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33832024-11-02T04:03:39.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c352517-1577-4a9d-887e-4009262feb85 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33842024-11-02T04:03:40.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd794716-2d77-4bf3-9cf0-17c495854387 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33852024-11-02T04:03:40.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd794716-2d77-4bf3-9cf0-17c495854387 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33862024-11-02T04:03:40.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd794716-2d77-4bf3-9cf0-17c495854387 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33872024-11-02T04:03:41.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd891fc5-84c3-4fe1-ae59-97bcdd0962d0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33882024-11-02T04:03:41.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd891fc5-84c3-4fe1-ae59-97bcdd0962d0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33892024-11-02T04:03:41.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd891fc5-84c3-4fe1-ae59-97bcdd0962d0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33902024-11-02T04:03:42.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0a41c3e-ecee-456a-ad94-cae1145994a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33912024-11-02T04:03:42.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0a41c3e-ecee-456a-ad94-cae1145994a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33922024-11-02T04:03:42.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a0a41c3e-ecee-456a-ad94-cae1145994a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33932024-11-02T04:03:43.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d24a4bd-7343-42bc-8c9f-68162c809ada roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33942024-11-02T04:03:43.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d24a4bd-7343-42bc-8c9f-68162c809ada resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33952024-11-02T04:03:43.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5d24a4bd-7343-42bc-8c9f-68162c809ada response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
33962024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
33972024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
33982024-11-02T04:03:43.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33992024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
34002024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34012024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34022024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34032024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
34042024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
34052024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34062024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
34072024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34082024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
34092024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
34102024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
34112024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34122024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34132024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34142024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34152024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
34162024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
34172024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34182024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34192024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
34202024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
34212024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34222024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34242024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34252024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34262024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34272024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34282024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34292024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34302024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34312024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34322024-11-02T04:03:43.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34332024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34342024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34352024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
34362024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.89\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
34372024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
34382024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
34392024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.71\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34402024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.02\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
34412024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
34422024-11-02T04:03:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.56\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34432024-11-02T04:03:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442024-11-02T04:03:43.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34452024-11-02T04:03:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34462024-11-02T04:03:43.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472024-11-02T04:03:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.254901ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34482024-11-02T04:03:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34492024-11-02T04:03:43.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34502024-11-02T04:03:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34512024-11-02T04:03:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34522024-11-02T04:03:43.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34532024-11-02T04:03:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34542024-11-02T04:03:43.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9727, tv_nsec: 525596152 } })
34552024-11-02T04:03:43.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
34562024-11-02T04:03:43.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572024-11-02T04:03:43.549ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34582024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34592024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34602024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34612024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34622024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-11-02T04:03:43.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-11-02T04:03:43.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34652024-11-02T04:03:43.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34662024-11-02T04:03:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34672024-11-02T04:03:43.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9727, tv_nsec: 528906453 } })
34682024-11-02T04:03:43.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
34692024-11-02T04:03:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34702024-11-02T04:03:43.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34712024-11-02T04:03:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34722024-11-02T04:03:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34732024-11-02T04:03:43.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34742024-11-02T04:03:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34752024-11-02T04:03:43.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9727, tv_nsec: 532495370 } })
34762024-11-02T04:03:43.555ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
34772024-11-02T04:03:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34782024-11-02T04:03:43.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34792024-11-02T04:03:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802024-11-02T04:03:43.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34812024-11-02T04:03:43.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34822024-11-02T04:03:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34832024-11-02T04:03:43.558ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34842024-11-02T04:03:43.558ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34852024-11-02T04:03:43.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34862024-11-02T04:03:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34872024-11-02T04:03:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34882024-11-02T04:03:43.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34892024-11-02T04:03:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34902024-11-02T04:03:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34912024-11-02T04:03:43.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34922024-11-02T04:03:43.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34932024-11-02T04:03:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34942024-11-02T04:03:43.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952024-11-02T04:03:43.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962024-11-02T04:03:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34972024-11-02T04:03:43.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34982024-11-02T04:03:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34992024-11-02T04:03:43.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
35002024-11-02T04:03:43.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35012024-11-02T04:03:43.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35022024-11-02T04:03:43.572ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.130149ms iteration = 17 status = {"physical_disks_added":0}
35032024-11-02T04:03:43.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35042024-11-02T04:03:43.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35052024-11-02T04:03:43.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35062024-11-02T04:03:43.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35072024-11-02T04:03:43.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35082024-11-02T04:03:43.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
35092024-11-02T04:03:43.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.728182ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
35102024-11-02T04:03:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
35112024-11-02T04:03:43.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35122024-11-02T04:03:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35132024-11-02T04:03:43.585ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 44.347702ms iteration = 14 status = 0
35142024-11-02T04:03:43.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35152024-11-02T04:03:43.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35162024-11-02T04:03:43.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.734575ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35172024-11-02T04:03:43.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.486756ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35182024-11-02T04:03:43.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35192024-11-02T04:03:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35202024-11-02T04:03:43.598ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35212024-11-02T04:03:43.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.332521ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35222024-11-02T04:03:43.608ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35232024-11-02T04:03:43.608ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35242024-11-02T04:03:43.608ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.05057ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35252024-11-02T04:03:43.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
35262024-11-02T04:03:43.637ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35272024-11-02T04:03:43.637ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aad772e8-54ba-4133-b075-f2ca7e43902c", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35282024-11-02T04:03:43.637ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35292024-11-02T04:03:43.639ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
35302024-11-02T04:03:43.639ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35312024-11-02T04:03:43.639ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec99db64-b687-4d42-a0b8-95914024135b", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35322024-11-02T04:03:43.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35332024-11-02T04:03:43.639ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
35342024-11-02T04:03:43.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35352024-11-02T04:03:43.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
35362024-11-02T04:03:43.642ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35372024-11-02T04:03:43.642ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14d7918-3f36-40b8-9b48-ac01d7f0bd64", "content-length": "26", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35382024-11-02T04:03:43.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35392024-11-02T04:03:43.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35402024-11-02T04:03:43.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35412024-11-02T04:03:43.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35422024-11-02T04:03:43.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35432024-11-02T04:03:43.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35442024-11-02T04:03:43.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35452024-11-02T04:03:43.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35462024-11-02T04:03:43.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-11-02T04:03:43.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35482024-11-02T04:03:43.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35492024-11-02T04:03:43.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35502024-11-02T04:03:43.711ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35512024-11-02T04:03:43.711ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35522024-11-02T04:03:43.711ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef50665b-4d78-43b2-8f6c-7611bf650604", "content-length": "372", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35532024-11-02T04:03:43.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35542024-11-02T04:03:43.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35552024-11-02T04:03:43.732ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35562024-11-02T04:03:43.732ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5a4ea57-0720-4a03-a169-f136d5b0e3b1", "content-length": "1", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35572024-11-02T04:03:43.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35582024-11-02T04:03:43.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35592024-11-02T04:03:43.736ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.790603ms iteration = 14 status = null
35602024-11-02T04:03:43.736ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.419207ms iteration = 14 status = {}
35612024-11-02T04:03:43.753ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35622024-11-02T04:03:43.753ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35632024-11-02T04:03:43.771ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35642024-11-02T04:03:43.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35652024-11-02T04:03:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35662024-11-02T04:03:43.812ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
35672024-11-02T04:03:43.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35682024-11-02T04:03:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35692024-11-02T04:03:43.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35702024-11-02T04:03:43.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f30a9643-b022-43ad-9c18-5f70f3959bea", "content-length": "134", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35712024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35722024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
35732024-11-02T04:03:43.824ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "45b029db-646d-42c5-99cb-91bde8627f58", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35742024-11-02T04:03:43.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35752024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35762024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35772024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35782024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35792024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35802024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35812024-11-02T04:03:43.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35822024-11-02T04:03:43.824ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9601459-ea95-4635-b52b-bb21c9741fc5", "content-length": "691", "date": "Sat, 02 Nov 2024 04:03:42 GMT"} })
35832024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35842024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35852024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35862024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35872024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35882024-11-02T04:03:43.824ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
35892024-11-02T04:03:43.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35902024-11-02T04:03:43.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35912024-11-02T04:03:43.826ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.900758ms iteration = 14 status = {}
35922024-11-02T04:03:43.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35932024-11-02T04:03:43.826ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35942024-11-02T04:03:43.827ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bafbeb2-aa51-4c85-a872-0adc36bd5e8e", "content-length": "2", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35952024-11-02T04:03:43.827ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35962024-11-02T04:03:43.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35972024-11-02T04:03:43.827ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d946f3f2-cbba-4ab6-9316-6be0ef3d9deb", "content-length": "52", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
35982024-11-02T04:03:43.827ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
35992024-11-02T04:03:43.827ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36002024-11-02T04:03:43.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36012024-11-02T04:03:43.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36022024-11-02T04:03:43.834ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36032024-11-02T04:03:43.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36042024-11-02T04:03:43.907ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:64312
36052024-11-02T04:03:43.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = db1b2e95-d28d-477a-92db-e416e8f8f32c roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
36062024-11-02T04:03:43.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = db1b2e95-d28d-477a-92db-e416e8f8f32c resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
36072024-11-02T04:03:43.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = db1b2e95-d28d-477a-92db-e416e8f8f32c response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
36082024-11-02T04:03:43.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 592f2a11-9ff7-489f-9dcd-4809e64a1ce1 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
36092024-11-02T04:03:43.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 592f2a11-9ff7-489f-9dcd-4809e64a1ce1 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
36102024-11-02T04:03:43.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 592f2a11-9ff7-489f-9dcd-4809e64a1ce1 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
36112024-11-02T04:03:43.928ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "274d52f9-7587-41e9-8d03-93a6f74456af", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
36122024-11-02T04:03:43.928ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
36132024-11-02T04:03:43.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36142024-11-02T04:03:43.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4093a380-4fec-4d39-8fb4-d493600f1f3d", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
36152024-11-02T04:03:43.930ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 389.363082ms iteration = 15 status = {}
36162024-11-02T04:03:43.930ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "51b44d3c-7ad5-4423-a9f5-a468e0b0020c", "content-length": "682", "date": "Sat, 02 Nov 2024 04:03:43 GMT"} })
36172024-11-02T04:03:43.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36182024-11-02T04:03:43.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36192024-11-02T04:03:43.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36202024-11-02T04:03:43.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36212024-11-02T04:03:43.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36222024-11-02T04:03:43.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36232024-11-02T04:03:43.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36242024-11-02T04:03:43.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36252024-11-02T04:03:43.948ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 406.720735ms iteration = 14 status = {}
36262024-11-02T04:03:44.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b986b1b-2b38-47d8-a6e9-4729c42ff35b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36272024-11-02T04:03:44.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b986b1b-2b38-47d8-a6e9-4729c42ff35b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36282024-11-02T04:03:44.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b986b1b-2b38-47d8-a6e9-4729c42ff35b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36292024-11-02T04:03:44.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 4d1c3c01-8a6d-4a9f-9078-ed61cb5adecd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36302024-11-02T04:03:44.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 4d1c3c01-8a6d-4a9f-9078-ed61cb5adecd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36312024-11-02T04:03:44.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 4d1c3c01-8a6d-4a9f-9078-ed61cb5adecd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36322024-11-02T04:03:45.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b638d3f-28aa-491f-96b9-7945e7ac40e7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36332024-11-02T04:03:45.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b638d3f-28aa-491f-96b9-7945e7ac40e7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36342024-11-02T04:03:45.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b638d3f-28aa-491f-96b9-7945e7ac40e7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36352024-11-02T04:03:46.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5244d0-1cc5-4610-a8c3-185b87d95b8b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36362024-11-02T04:03:46.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5244d0-1cc5-4610-a8c3-185b87d95b8b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36372024-11-02T04:03:46.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5244d0-1cc5-4610-a8c3-185b87d95b8b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36382024-11-02T04:03:47.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a332bc77-6c71-43a5-b32d-be1920a360cc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36392024-11-02T04:03:47.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a332bc77-6c71-43a5-b32d-be1920a360cc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36402024-11-02T04:03:47.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a332bc77-6c71-43a5-b32d-be1920a360cc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36412024-11-02T04:03:48.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 404c1224-2f5b-4900-94ec-533edfb62801 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36422024-11-02T04:03:48.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 404c1224-2f5b-4900-94ec-533edfb62801 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36432024-11-02T04:03:48.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 404c1224-2f5b-4900-94ec-533edfb62801 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36442024-11-02T04:03:49.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb886c3e-906c-46d3-a41f-8874de6e50c4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36452024-11-02T04:03:49.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb886c3e-906c-46d3-a41f-8874de6e50c4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36462024-11-02T04:03:49.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb886c3e-906c-46d3-a41f-8874de6e50c4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36472024-11-02T04:03:50.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b900772-7f23-44e5-889b-12cec9c2ff4b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36482024-11-02T04:03:50.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b900772-7f23-44e5-889b-12cec9c2ff4b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36492024-11-02T04:03:50.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b900772-7f23-44e5-889b-12cec9c2ff4b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36502024-11-02T04:03:51.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5a93692-06bd-4005-9d0b-8a6cf5ef2f71 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36512024-11-02T04:03:51.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5a93692-06bd-4005-9d0b-8a6cf5ef2f71 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36522024-11-02T04:03:51.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5a93692-06bd-4005-9d0b-8a6cf5ef2f71 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36532024-11-02T04:03:52.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c04437f6-eb62-41db-a653-de92377b46f6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36542024-11-02T04:03:52.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c04437f6-eb62-41db-a653-de92377b46f6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36552024-11-02T04:03:52.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c04437f6-eb62-41db-a653-de92377b46f6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36562024-11-02T04:03:53.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00c170d7-45d7-44ae-8326-e91b6b5e517f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36572024-11-02T04:03:53.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00c170d7-45d7-44ae-8326-e91b6b5e517f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36582024-11-02T04:03:53.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00c170d7-45d7-44ae-8326-e91b6b5e517f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36592024-11-02T04:03:53.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
36602024-11-02T04:03:53.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
36612024-11-02T04:03:53.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36622024-11-02T04:03:53.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36632024-11-02T04:03:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36642024-11-02T04:03:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36652024-11-02T04:03:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662024-11-02T04:03:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36672024-11-02T04:03:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36682024-11-02T04:03:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36692024-11-02T04:03:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36702024-11-02T04:03:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36712024-11-02T04:03:53.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-11-02T04:03:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
36732024-11-02T04:03:53.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36742024-11-02T04:03:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36752024-11-02T04:03:53.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
36762024-11-02T04:03:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.308246ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
36772024-11-02T04:03:53.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36782024-11-02T04:03:53.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36792024-11-02T04:03:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.507454ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36802024-11-02T04:03:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1448 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 603ca244-f23d-4ab9-8b68-7ceef9fd6197 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
36812024-11-02T04:03:54.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a2eed525-11e3-4e38-9e8d-6328a41003f6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36822024-11-02T04:03:54.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a2eed525-11e3-4e38-9e8d-6328a41003f6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36832024-11-02T04:03:54.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a2eed525-11e3-4e38-9e8d-6328a41003f6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36842024-11-02T04:03:55.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2664b79b-0ecf-45ce-a6ad-6b9c57814122 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36852024-11-02T04:03:55.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2664b79b-0ecf-45ce-a6ad-6b9c57814122 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36862024-11-02T04:03:55.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2664b79b-0ecf-45ce-a6ad-6b9c57814122 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36872024-11-02T04:03:56.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66027813-8f7c-4bcf-bd80-60489651dcdb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36882024-11-02T04:03:56.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66027813-8f7c-4bcf-bd80-60489651dcdb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36892024-11-02T04:03:56.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66027813-8f7c-4bcf-bd80-60489651dcdb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36902024-11-02T04:03:57.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6444e208-3d0d-43f1-9d5a-c900b498bdf9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36912024-11-02T04:03:57.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6444e208-3d0d-43f1-9d5a-c900b498bdf9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36922024-11-02T04:03:57.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6444e208-3d0d-43f1-9d5a-c900b498bdf9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36932024-11-02T04:03:58.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b90449a5-6e23-4c63-9260-4b3e600499eb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36942024-11-02T04:03:58.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b90449a5-6e23-4c63-9260-4b3e600499eb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36952024-11-02T04:03:58.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b90449a5-6e23-4c63-9260-4b3e600499eb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36962024-11-02T04:03:59.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc6c0749-d625-4566-8268-829684ea55f3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36972024-11-02T04:03:59.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc6c0749-d625-4566-8268-829684ea55f3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36982024-11-02T04:03:59.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc6c0749-d625-4566-8268-829684ea55f3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
36992024-11-02T04:04:00.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7366e437-9b86-47b5-9f4b-41ca2dd2b029 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37002024-11-02T04:04:00.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7366e437-9b86-47b5-9f4b-41ca2dd2b029 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37012024-11-02T04:04:00.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7366e437-9b86-47b5-9f4b-41ca2dd2b029 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37022024-11-02T04:04:01.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f9ded7f-a3b4-4513-af10-f64ae5b48b25 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37032024-11-02T04:04:01.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f9ded7f-a3b4-4513-af10-f64ae5b48b25 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37042024-11-02T04:04:01.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f9ded7f-a3b4-4513-af10-f64ae5b48b25 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37052024-11-02T04:04:02.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d973cd25-9726-4f7d-bc1a-7ca5f0e98c7a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37062024-11-02T04:04:02.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d973cd25-9726-4f7d-bc1a-7ca5f0e98c7a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37072024-11-02T04:04:02.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d973cd25-9726-4f7d-bc1a-7ca5f0e98c7a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37082024-11-02T04:04:03.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
37092024-11-02T04:04:03.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37102024-11-02T04:04:03.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
37112024-11-02T04:04:03.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37122024-11-02T04:04:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37132024-11-02T04:04:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37142024-11-02T04:04:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37152024-11-02T04:04:03.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37162024-11-02T04:04:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37172024-11-02T04:04:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37182024-11-02T04:04:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192024-11-02T04:04:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37202024-11-02T04:04:03.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.62763ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37212024-11-02T04:04:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-11-02T04:04:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-11-02T04:04:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-11-02T04:04:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
37252024-11-02T04:04:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262024-11-02T04:04:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272024-11-02T04:04:03.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
37282024-11-02T04:04:03.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.580095ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
37292024-11-02T04:04:03.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db3acf8b-c590-4b82-98fe-299078351220 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37302024-11-02T04:04:03.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db3acf8b-c590-4b82-98fe-299078351220 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37312024-11-02T04:04:03.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db3acf8b-c590-4b82-98fe-299078351220 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37322024-11-02T04:04:04.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19ad3060-eba2-401b-949d-a25474c57faf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37332024-11-02T04:04:04.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19ad3060-eba2-401b-949d-a25474c57faf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37342024-11-02T04:04:04.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19ad3060-eba2-401b-949d-a25474c57faf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37352024-11-02T04:04:05.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c205555-d386-4690-959e-c35794792b31 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37362024-11-02T04:04:05.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c205555-d386-4690-959e-c35794792b31 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37372024-11-02T04:04:05.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c205555-d386-4690-959e-c35794792b31 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37382024-11-02T04:04:06.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e858942-b9a5-47ca-9857-071c21c0ca2d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37392024-11-02T04:04:06.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e858942-b9a5-47ca-9857-071c21c0ca2d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37402024-11-02T04:04:06.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e858942-b9a5-47ca-9857-071c21c0ca2d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37412024-11-02T04:04:07.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 129c9ac4-afdc-4367-92be-66dc6e4019ea roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37422024-11-02T04:04:07.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 129c9ac4-afdc-4367-92be-66dc6e4019ea resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37432024-11-02T04:04:07.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 129c9ac4-afdc-4367-92be-66dc6e4019ea response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37442024-11-02T04:04:08.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 10c3f2ed-7820-4c5b-a00d-2e420aefc4da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37452024-11-02T04:04:08.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 10c3f2ed-7820-4c5b-a00d-2e420aefc4da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37462024-11-02T04:04:08.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 10c3f2ed-7820-4c5b-a00d-2e420aefc4da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37472024-11-02T04:04:08.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 96921c82-f422-4c86-b2bf-4c77aca48aef response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
37482024-11-02T04:04:09.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd801d0b-97f6-4b50-9309-3f365d323e2d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37492024-11-02T04:04:09.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd801d0b-97f6-4b50-9309-3f365d323e2d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37502024-11-02T04:04:09.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd801d0b-97f6-4b50-9309-3f365d323e2d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37512024-11-02T04:04:10.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f89218e7-32eb-446c-835f-0f7732709ac3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37522024-11-02T04:04:10.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f89218e7-32eb-446c-835f-0f7732709ac3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37532024-11-02T04:04:10.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f89218e7-32eb-446c-835f-0f7732709ac3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37542024-11-02T04:04:11.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d21f4c28-8359-49a5-bf9f-b1cb02c6dc4f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37552024-11-02T04:04:11.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d21f4c28-8359-49a5-bf9f-b1cb02c6dc4f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37562024-11-02T04:04:11.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d21f4c28-8359-49a5-bf9f-b1cb02c6dc4f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37572024-11-02T04:04:12.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 328165e9-7f45-4c61-96ed-9d169a606c50 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37582024-11-02T04:04:12.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 328165e9-7f45-4c61-96ed-9d169a606c50 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37592024-11-02T04:04:12.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 328165e9-7f45-4c61-96ed-9d169a606c50 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
37602024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
37612024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
37622024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
37632024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37642024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
37652024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
37662024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37672024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
37682024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37692024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37702024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37712024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
37722024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
37732024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37742024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37752024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37762024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
37772024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
37782024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
37792024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
37802024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37812024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37822024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
37832024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37842024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
37852024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
37862024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37872024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
37882024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37892024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37902024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37912024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
37922024-11-02T04:04:13.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37932024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
37942024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37952024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
37962024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37972024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
37982024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37992024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
38002024-11-02T04:04:13.541ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
38012024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
38022024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.55\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
38032024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
38052024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
38062024-11-02T04:04:13.541ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38072024-11-02T04:04:13.541ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:54:13.541700354 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38082024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38092024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38102024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38112024-11-02T04:04:13.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38122024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38132024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38142024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38152024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38162024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38172024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38182024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38192024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
38202024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
38212024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38222024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.8\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
38232024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
38242024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
38252024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38262024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.99\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38272024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
38282024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38292024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.68\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38302024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38312024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
38322024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38332024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38342024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.781\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
38352024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38362024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38372024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38382024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38392024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38402024-11-02T04:04:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9757, tv_nsec: 519149194 } })
38412024-11-02T04:04:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9757, tv_nsec: 519163194 } })
38422024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38432024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38442024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38452024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
38462024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.286648ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
38472024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38482024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
38492024-11-02T04:04:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.326288ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
38502024-11-02T04:04:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38512024-11-02T04:04:13.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38522024-11-02T04:04:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38532024-11-02T04:04:13.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38542024-11-02T04:04:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.104589ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38552024-11-02T04:04:13.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38562024-11-02T04:04:13.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38572024-11-02T04:04:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38582024-11-02T04:04:13.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38592024-11-02T04:04:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38602024-11-02T04:04:13.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38612024-11-02T04:04:13.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38622024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38632024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38642024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38652024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38662024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38672024-11-02T04:04:13.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38682024-11-02T04:04:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38692024-11-02T04:04:13.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9757, tv_nsec: 529234740 } })
38702024-11-02T04:04:13.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
38712024-11-02T04:04:13.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722024-11-02T04:04:13.553ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38732024-11-02T04:04:13.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-11-02T04:04:13.554ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:54:13.541700354 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38752024-11-02T04:04:13.554ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.838516ms iteration = 8 status = {"expiration":"2024-11-02T03:54:13.541700354Z","pruned":[]}
38762024-11-02T04:04:13.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38772024-11-02T04:04:13.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38782024-11-02T04:04:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38792024-11-02T04:04:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38802024-11-02T04:04:13.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38812024-11-02T04:04:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38822024-11-02T04:04:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38832024-11-02T04:04:13.557ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38842024-11-02T04:04:13.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38852024-11-02T04:04:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38862024-11-02T04:04:13.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38872024-11-02T04:04:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38882024-11-02T04:04:13.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9757, tv_nsec: 535373922 } })
38892024-11-02T04:04:13.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
38902024-11-02T04:04:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38912024-11-02T04:04:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38922024-11-02T04:04:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38932024-11-02T04:04:13.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942024-11-02T04:04:13.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9757, tv_nsec: 545012869 } })
38952024-11-02T04:04:13.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
38962024-11-02T04:04:13.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38972024-11-02T04:04:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38982024-11-02T04:04:13.570ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 28.443761ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
38992024-11-02T04:04:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39002024-11-02T04:04:13.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39012024-11-02T04:04:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39022024-11-02T04:04:13.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39032024-11-02T04:04:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39042024-11-02T04:04:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39052024-11-02T04:04:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39062024-11-02T04:04:13.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-11-02T04:04:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39082024-11-02T04:04:13.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39092024-11-02T04:04:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39102024-11-02T04:04:13.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39112024-11-02T04:04:13.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39122024-11-02T04:04:13.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39132024-11-02T04:04:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39142024-11-02T04:04:13.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39152024-11-02T04:04:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39162024-11-02T04:04:13.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39172024-11-02T04:04:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39182024-11-02T04:04:13.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.009644ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39192024-11-02T04:04:13.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39212024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39222024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39232024-11-02T04:04:13.616ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39242024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.327816ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39252024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39262024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39272024-11-02T04:04:13.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39282024-11-02T04:04:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39292024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39302024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39312024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39322024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39332024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39342024-11-02T04:04:13.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39352024-11-02T04:04:13.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39362024-11-02T04:04:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39372024-11-02T04:04:13.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-11-02T04:04:13.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-11-02T04:04:13.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39402024-11-02T04:04:13.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39412024-11-02T04:04:13.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39422024-11-02T04:04:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39432024-11-02T04:04:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
39442024-11-02T04:04:13.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39452024-11-02T04:04:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39462024-11-02T04:04:13.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39472024-11-02T04:04:13.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39482024-11-02T04:04:13.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39492024-11-02T04:04:13.629ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39502024-11-02T04:04:13.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.200044ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39512024-11-02T04:04:13.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39522024-11-02T04:04:13.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39532024-11-02T04:04:13.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-11-02T04:04:13.632ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39552024-11-02T04:04:13.632ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39562024-11-02T04:04:13.632ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.78436ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39572024-11-02T04:04:13.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
39582024-11-02T04:04:13.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39592024-11-02T04:04:13.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39602024-11-02T04:04:13.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.186069ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39612024-11-02T04:04:13.648ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39622024-11-02T04:04:13.648ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39632024-11-02T04:04:13.648ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39642024-11-02T04:04:13.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39652024-11-02T04:04:13.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39662024-11-02T04:04:13.653ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39672024-11-02T04:04:13.653ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39682024-11-02T04:04:13.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39692024-11-02T04:04:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39702024-11-02T04:04:13.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
39712024-11-02T04:04:13.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39722024-11-02T04:04:13.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39732024-11-02T04:04:13.697ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.670303ms iteration = 18 status = {"physical_disks_added":0}
39742024-11-02T04:04:13.713ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
39752024-11-02T04:04:13.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
39762024-11-02T04:04:13.731ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39772024-11-02T04:04:13.732ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c009e6-8e9a-4612-8865-b7f3476f3db5", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:12 GMT"} })
39782024-11-02T04:04:13.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39792024-11-02T04:04:13.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39802024-11-02T04:04:13.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
39812024-11-02T04:04:13.748ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39822024-11-02T04:04:13.748ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1831559-b9b4-4b17-82bc-5cad96b5711d", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:12 GMT"} })
39832024-11-02T04:04:13.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39842024-11-02T04:04:13.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39852024-11-02T04:04:13.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
39862024-11-02T04:04:13.771ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39872024-11-02T04:04:13.771ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "627b78e6-57b0-4b14-bd0f-a2e57fa87729", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:12 GMT"} })
39882024-11-02T04:04:13.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39892024-11-02T04:04:13.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
39902024-11-02T04:04:13.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5138f6e-900d-4403-b085-195a72fd1487 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
39912024-11-02T04:04:13.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5138f6e-900d-4403-b085-195a72fd1487 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
39922024-11-02T04:04:13.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39932024-11-02T04:04:13.841ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39942024-11-02T04:04:13.841ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39952024-11-02T04:04:13.841ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7802186-9fe8-428e-aa85-1b70aa0b9eea", "content-length": "372", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
39962024-11-02T04:04:13.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39972024-11-02T04:04:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39982024-11-02T04:04:13.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 304.733705ms iteration = 15 status = 0
39992024-11-02T04:04:13.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002024-11-02T04:04:13.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5138f6e-900d-4403-b085-195a72fd1487 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
40012024-11-02T04:04:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40022024-11-02T04:04:13.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40032024-11-02T04:04:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40042024-11-02T04:04:13.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
40052024-11-02T04:04:13.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 329.373643ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
40062024-11-02T04:04:13.882ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40072024-11-02T04:04:13.882ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40082024-11-02T04:04:13.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40092024-11-02T04:04:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40102024-11-02T04:04:13.887ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40112024-11-02T04:04:13.887ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
40122024-11-02T04:04:13.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40132024-11-02T04:04:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40142024-11-02T04:04:13.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40152024-11-02T04:04:13.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40162024-11-02T04:04:13.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-11-02T04:04:13.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40182024-11-02T04:04:13.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40192024-11-02T04:04:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40202024-11-02T04:04:13.896ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40212024-11-02T04:04:13.896ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40222024-11-02T04:04:13.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 354.527854ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40232024-11-02T04:04:13.899ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
40242024-11-02T04:04:13.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40252024-11-02T04:04:13.899ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.771804ms iteration = 15 status = {}
40262024-11-02T04:04:13.899ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "31045fd7-be1f-444d-a9b0-c45c0233e468", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
40272024-11-02T04:04:13.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40282024-11-02T04:04:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40292024-11-02T04:04:13.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40302024-11-02T04:04:13.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0a5b6b36-f7e3-47c7-8d12-4556455d9ce3", "date": "Sat, 02 Nov 2024 04:04:12 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
40312024-11-02T04:04:13.900ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
40322024-11-02T04:04:13.901ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40332024-11-02T04:04:13.901ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45e917aa-f9a2-46cd-9af4-e8adbe6f10d8", "content-length": "1", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
40342024-11-02T04:04:13.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40352024-11-02T04:04:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40362024-11-02T04:04:13.903ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d738196c-095a-49ae-84e7-9ae70e40abed", "date": "Sat, 02 Nov 2024 04:04:12 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
40372024-11-02T04:04:13.903ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
40382024-11-02T04:04:13.903ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40392024-11-02T04:04:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40402024-11-02T04:04:13.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40412024-11-02T04:04:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40422024-11-02T04:04:13.905ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 364.257893ms iteration = 15 status = null
40432024-11-02T04:04:13.905ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
40442024-11-02T04:04:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 364.645172ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
40452024-11-02T04:04:13.908ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40462024-11-02T04:04:13.908ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40472024-11-02T04:04:13.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6dffc9b5-7533-4676-b35e-a57d64436f6e", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
40482024-11-02T04:04:13.910ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 368.975255ms iteration = 16 status = {}
40492024-11-02T04:04:13.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40502024-11-02T04:04:13.922ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "84600a66-7f02-45b4-b4cf-3d2225a08136", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40512024-11-02T04:04:13.922ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40522024-11-02T04:04:13.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1cfe35d0-221c-4a51-ba57-d0716aebbad2", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40532024-11-02T04:04:13.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40542024-11-02T04:04:13.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40552024-11-02T04:04:13.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40562024-11-02T04:04:13.925ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c094ad03-35ce-41aa-bf1e-34841f3c034a", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40572024-11-02T04:04:13.925ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40582024-11-02T04:04:13.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40592024-11-02T04:04:13.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40602024-11-02T04:04:13.927ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
40612024-11-02T04:04:13.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40622024-11-02T04:04:13.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 386.265496ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
40632024-11-02T04:04:13.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40642024-11-02T04:04:13.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40652024-11-02T04:04:13.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40662024-11-02T04:04:13.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40672024-11-02T04:04:13.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40682024-11-02T04:04:13.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40692024-11-02T04:04:13.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40702024-11-02T04:04:13.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40712024-11-02T04:04:13.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40722024-11-02T04:04:13.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40732024-11-02T04:04:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40742024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40752024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
40762024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40772024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40782024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
40792024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 390.69332ms iteration = 9 status = {"generation":2}
40802024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
40812024-11-02T04:04:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 390.68646ms iteration = 9 status = {"generation":1}
40822024-11-02T04:04:13.963ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40832024-11-02T04:04:13.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 422.046734ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40842024-11-02T04:04:13.966ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
40852024-11-02T04:04:13.966ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 425.233872ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40862024-11-02T04:04:13.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40872024-11-02T04:04:13.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40882024-11-02T04:04:13.989ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
40892024-11-02T04:04:13.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40902024-11-02T04:04:13.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40912024-11-02T04:04:13.999ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40922024-11-02T04:04:14.000ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1bebd1-769b-4d72-976d-3ad9294383c0", "content-length": "134", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
40932024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40942024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
40952024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40962024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40972024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40982024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40992024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41002024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41012024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41022024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41032024-11-02T04:04:14.000ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
41042024-11-02T04:04:14.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41052024-11-02T04:04:14.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41062024-11-02T04:04:14.003ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41072024-11-02T04:04:14.003ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4099768-cb0f-4d74-a011-684605472478", "content-length": "2", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
41082024-11-02T04:04:14.003ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41092024-11-02T04:04:14.003ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf7c60b1-86b8-4b96-9504-d6d33f2c1107", "content-length": "52", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
41102024-11-02T04:04:14.003ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
41112024-11-02T04:04:14.003ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41122024-11-02T04:04:14.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41132024-11-02T04:04:14.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5284113c-e5d6-4f8f-950f-c577ecf07abf", "content-length": "691", "date": "Sat, 02 Nov 2024 04:04:14 GMT"} })
41142024-11-02T04:04:14.039ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41152024-11-02T04:04:14.039ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41162024-11-02T04:04:14.039ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41172024-11-02T04:04:14.041ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 499.61811ms iteration = 15 status = {}
41182024-11-02T04:04:14.137ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "63a119c0-ee0b-4347-b6f8-bd5d0a8fa800", "date": "Sat, 02 Nov 2024 04:04:13 GMT"} })
41192024-11-02T04:04:14.137ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
41202024-11-02T04:04:14.137ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41212024-11-02T04:04:14.137ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "124983cc-9b29-4238-9483-7d9a1d7248ed", "content-length": "682", "date": "Sat, 02 Nov 2024 04:04:14 GMT"} })
41222024-11-02T04:04:14.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41232024-11-02T04:04:14.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41242024-11-02T04:04:14.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41252024-11-02T04:04:14.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41262024-11-02T04:04:14.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41272024-11-02T04:04:14.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41282024-11-02T04:04:14.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41292024-11-02T04:04:14.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41302024-11-02T04:04:14.154ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 613.511666ms iteration = 15 status = {}
41312024-11-02T04:04:14.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a63504a9-220f-4c3c-b5fd-8089f4262a64 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41322024-11-02T04:04:14.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a63504a9-220f-4c3c-b5fd-8089f4262a64 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41332024-11-02T04:04:14.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a63504a9-220f-4c3c-b5fd-8089f4262a64 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41342024-11-02T04:04:14.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb6c2e9-c211-46b5-9577-96f981318784 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41352024-11-02T04:04:14.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb6c2e9-c211-46b5-9577-96f981318784 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41362024-11-02T04:04:14.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb6c2e9-c211-46b5-9577-96f981318784 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41372024-11-02T04:04:15.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 385199ae-20d8-4c06-a9f0-8ab2a036cdcd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41382024-11-02T04:04:15.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 385199ae-20d8-4c06-a9f0-8ab2a036cdcd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41392024-11-02T04:04:15.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 385199ae-20d8-4c06-a9f0-8ab2a036cdcd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41402024-11-02T04:04:16.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0058d366-8103-41c4-8b58-125c415c3454 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41412024-11-02T04:04:16.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0058d366-8103-41c4-8b58-125c415c3454 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41422024-11-02T04:04:16.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0058d366-8103-41c4-8b58-125c415c3454 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41432024-11-02T04:04:17.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fcf26d19-eef6-4f45-820b-543d3a7670fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41442024-11-02T04:04:17.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fcf26d19-eef6-4f45-820b-543d3a7670fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41452024-11-02T04:04:17.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fcf26d19-eef6-4f45-820b-543d3a7670fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41462024-11-02T04:04:18.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d71ffd1b-612d-4460-b2f5-2e828b786daa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41472024-11-02T04:04:18.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d71ffd1b-612d-4460-b2f5-2e828b786daa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41482024-11-02T04:04:18.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d71ffd1b-612d-4460-b2f5-2e828b786daa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41492024-11-02T04:04:19.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b92a76b9-3ef0-499c-878c-9bafe0421aef roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41502024-11-02T04:04:19.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b92a76b9-3ef0-499c-878c-9bafe0421aef resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41512024-11-02T04:04:19.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b92a76b9-3ef0-499c-878c-9bafe0421aef response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41522024-11-02T04:04:21.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9f6c03d6-9819-45a3-af54-694bde2fc52d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41532024-11-02T04:04:21.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9f6c03d6-9819-45a3-af54-694bde2fc52d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41542024-11-02T04:04:21.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9f6c03d6-9819-45a3-af54-694bde2fc52d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41552024-11-02T04:04:22.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 708e9875-ede0-4636-b6d9-dba1d54f27ec roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41562024-11-02T04:04:22.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 708e9875-ede0-4636-b6d9-dba1d54f27ec resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41572024-11-02T04:04:22.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 708e9875-ede0-4636-b6d9-dba1d54f27ec response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41582024-11-02T04:04:23.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5b059269-cfa2-4c41-927a-c6ad2cbd8646 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41592024-11-02T04:04:23.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5b059269-cfa2-4c41-927a-c6ad2cbd8646 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41602024-11-02T04:04:23.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5b059269-cfa2-4c41-927a-c6ad2cbd8646 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41612024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
41622024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
41632024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41642024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41652024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41662024-11-02T04:04:23.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41672024-11-02T04:04:23.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41682024-11-02T04:04:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41692024-11-02T04:04:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41702024-11-02T04:04:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41712024-11-02T04:04:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41722024-11-02T04:04:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41732024-11-02T04:04:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742024-11-02T04:04:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
41752024-11-02T04:04:23.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41762024-11-02T04:04:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41772024-11-02T04:04:23.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
41782024-11-02T04:04:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.585115ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
41792024-11-02T04:04:23.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41802024-11-02T04:04:23.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41812024-11-02T04:04:23.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.188763ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41822024-11-02T04:04:23.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1308 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 1f47ff92-0e12-4bd0-9eb9-feaf2336a3ef response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
41832024-11-02T04:04:24.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ea107e1-8f97-4790-be30-7fc106b955fb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41842024-11-02T04:04:24.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ea107e1-8f97-4790-be30-7fc106b955fb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41852024-11-02T04:04:24.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ea107e1-8f97-4790-be30-7fc106b955fb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41862024-11-02T04:04:25.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 645af637-aa51-459b-9ab7-9c15c3cfc793 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41872024-11-02T04:04:25.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 645af637-aa51-459b-9ab7-9c15c3cfc793 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41882024-11-02T04:04:25.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 645af637-aa51-459b-9ab7-9c15c3cfc793 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41892024-11-02T04:04:26.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3a68dcf-9299-4569-8022-148c4b617b93 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41902024-11-02T04:04:26.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3a68dcf-9299-4569-8022-148c4b617b93 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41912024-11-02T04:04:26.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3a68dcf-9299-4569-8022-148c4b617b93 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41922024-11-02T04:04:27.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c251300f-4682-4929-9c63-d30cbd370c99 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41932024-11-02T04:04:27.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c251300f-4682-4929-9c63-d30cbd370c99 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41942024-11-02T04:04:27.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c251300f-4682-4929-9c63-d30cbd370c99 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41952024-11-02T04:04:28.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = da4973c0-bde4-432a-b794-00f6d8c3a8c4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41962024-11-02T04:04:28.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = da4973c0-bde4-432a-b794-00f6d8c3a8c4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41972024-11-02T04:04:28.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = da4973c0-bde4-432a-b794-00f6d8c3a8c4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
41982024-11-02T04:04:28.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 14f81acd-aab3-47b1-b452-6106ff01139e roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
41992024-11-02T04:04:28.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 14f81acd-aab3-47b1-b452-6106ff01139e resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
42002024-11-02T04:04:28.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 14f81acd-aab3-47b1-b452-6106ff01139e response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
42012024-11-02T04:04:28.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 147b17c5-7ee5-41b5-9922-0b268a7fe532 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
42022024-11-02T04:04:28.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 147b17c5-7ee5-41b5-9922-0b268a7fe532 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
42032024-11-02T04:04:28.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 147b17c5-7ee5-41b5-9922-0b268a7fe532 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
42042024-11-02T04:04:29.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ccfe3fe-28dd-4027-b35f-485497837d97 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42052024-11-02T04:04:29.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ccfe3fe-28dd-4027-b35f-485497837d97 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42062024-11-02T04:04:29.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ccfe3fe-28dd-4027-b35f-485497837d97 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42072024-11-02T04:04:30.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a7e222ab-7dff-46a6-8b92-91184007fa23 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42082024-11-02T04:04:30.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a7e222ab-7dff-46a6-8b92-91184007fa23 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42092024-11-02T04:04:30.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a7e222ab-7dff-46a6-8b92-91184007fa23 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42102024-11-02T04:04:31.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f95bfc84-102c-4b00-9e41-57d208e914bd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42112024-11-02T04:04:31.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f95bfc84-102c-4b00-9e41-57d208e914bd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42122024-11-02T04:04:31.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f95bfc84-102c-4b00-9e41-57d208e914bd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42132024-11-02T04:04:32.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7eebb873-c265-4efa-ab38-bb14ed5ef653 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42142024-11-02T04:04:32.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7eebb873-c265-4efa-ab38-bb14ed5ef653 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42152024-11-02T04:04:32.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7eebb873-c265-4efa-ab38-bb14ed5ef653 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42162024-11-02T04:04:33.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1076a697-32e5-402d-adbe-304fb53d116b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42172024-11-02T04:04:33.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1076a697-32e5-402d-adbe-304fb53d116b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42182024-11-02T04:04:33.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1076a697-32e5-402d-adbe-304fb53d116b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42192024-11-02T04:04:33.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
42202024-11-02T04:04:33.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
42212024-11-02T04:04:33.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42222024-11-02T04:04:33.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42232024-11-02T04:04:33.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42242024-11-02T04:04:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42252024-11-02T04:04:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-11-02T04:04:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42272024-11-02T04:04:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42282024-11-02T04:04:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42292024-11-02T04:04:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42302024-11-02T04:04:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42312024-11-02T04:04:33.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42322024-11-02T04:04:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
42332024-11-02T04:04:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42342024-11-02T04:04:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42352024-11-02T04:04:33.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
42362024-11-02T04:04:33.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.40162ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
42372024-11-02T04:04:33.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42382024-11-02T04:04:33.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42392024-11-02T04:04:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.556213ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42402024-11-02T04:04:34.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5a21986a-1a4a-4db3-bde0-385d48911cda roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42412024-11-02T04:04:34.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5a21986a-1a4a-4db3-bde0-385d48911cda resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42422024-11-02T04:04:34.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5a21986a-1a4a-4db3-bde0-385d48911cda response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42432024-11-02T04:04:35.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41bdc255-39d0-41af-acc3-f89f95063816 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42442024-11-02T04:04:35.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41bdc255-39d0-41af-acc3-f89f95063816 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42452024-11-02T04:04:35.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41bdc255-39d0-41af-acc3-f89f95063816 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42462024-11-02T04:04:36.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9e523c9-bbb8-46a1-8e4a-bd34ee7baa4a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42472024-11-02T04:04:36.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9e523c9-bbb8-46a1-8e4a-bd34ee7baa4a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42482024-11-02T04:04:36.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9e523c9-bbb8-46a1-8e4a-bd34ee7baa4a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42492024-11-02T04:04:37.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69bb9c0d-b2e5-44d5-8fa5-f85ea3173a7e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42502024-11-02T04:04:37.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69bb9c0d-b2e5-44d5-8fa5-f85ea3173a7e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42512024-11-02T04:04:37.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69bb9c0d-b2e5-44d5-8fa5-f85ea3173a7e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42522024-11-02T04:04:38.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8fd52-f6de-4115-acd9-e459ae288e9d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42532024-11-02T04:04:38.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8fd52-f6de-4115-acd9-e459ae288e9d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42542024-11-02T04:04:38.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8fd52-f6de-4115-acd9-e459ae288e9d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42552024-11-02T04:04:38.914ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1313 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 1301785e-a58e-44d3-9b62-c71e98cabbd5 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
42562024-11-02T04:04:39.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a53c41ef-edb7-459f-a011-83faa047b810 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42572024-11-02T04:04:39.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a53c41ef-edb7-459f-a011-83faa047b810 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42582024-11-02T04:04:39.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a53c41ef-edb7-459f-a011-83faa047b810 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42592024-11-02T04:04:40.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 75954940-9d96-463d-8e47-25b0811766fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42602024-11-02T04:04:40.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 75954940-9d96-463d-8e47-25b0811766fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42612024-11-02T04:04:40.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 75954940-9d96-463d-8e47-25b0811766fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42622024-11-02T04:04:41.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1dfb2972-1683-48fb-91a5-83b90fb54515 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42632024-11-02T04:04:41.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1dfb2972-1683-48fb-91a5-83b90fb54515 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42642024-11-02T04:04:41.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1dfb2972-1683-48fb-91a5-83b90fb54515 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42652024-11-02T04:04:42.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f90a772-e999-472d-ad63-d1fcc51cb3ed roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42662024-11-02T04:04:42.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f90a772-e999-472d-ad63-d1fcc51cb3ed resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42672024-11-02T04:04:42.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f90a772-e999-472d-ad63-d1fcc51cb3ed response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42682024-11-02T04:04:43.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b34dfff8-9dfe-490c-9057-5a6e757613fe roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42692024-11-02T04:04:43.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b34dfff8-9dfe-490c-9057-5a6e757613fe resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42702024-11-02T04:04:43.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b34dfff8-9dfe-490c-9057-5a6e757613fe response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
42712024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
42722024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
42732024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42742024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
42752024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42762024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42772024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
42782024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42792024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
42802024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
42812024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42822024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42832024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
42842024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42852024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
42862024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
42872024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42882024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
42902024-11-02T04:04:43.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42912024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
42922024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42932024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
42942024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42952024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
42962024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42972024-11-02T04:04:43.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42982024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42992024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43002024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43012024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43022024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43032024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43042024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43052024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43062024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43072024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43082024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43092024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43102024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
43112024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
43122024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
43132024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.62\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
43142024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.12\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
43152024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.85\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43162024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
43172024-11-02T04:04:43.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.91\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43182024-11-02T04:04:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43192024-11-02T04:04:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43202024-11-02T04:04:43.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9787, tv_nsec: 522043076 } })
43212024-11-02T04:04:43.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-11-02T04:04:43.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
43232024-11-02T04:04:43.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242024-11-02T04:04:43.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.233191ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43252024-11-02T04:04:43.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43262024-11-02T04:04:43.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43272024-11-02T04:04:43.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9787, tv_nsec: 523624210 } })
43282024-11-02T04:04:43.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
43292024-11-02T04:04:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43302024-11-02T04:04:43.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43312024-11-02T04:04:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43322024-11-02T04:04:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43332024-11-02T04:04:43.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43342024-11-02T04:04:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43352024-11-02T04:04:43.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43372024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43382024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43392024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43402024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43412024-11-02T04:04:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43422024-11-02T04:04:43.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432024-11-02T04:04:43.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43442024-11-02T04:04:43.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43452024-11-02T04:04:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43462024-11-02T04:04:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43472024-11-02T04:04:43.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43482024-11-02T04:04:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43492024-11-02T04:04:43.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43502024-11-02T04:04:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43512024-11-02T04:04:43.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43522024-11-02T04:04:43.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43532024-11-02T04:04:43.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9787, tv_nsec: 533772917 } })
43542024-11-02T04:04:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43552024-11-02T04:04:43.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
43562024-11-02T04:04:43.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43572024-11-02T04:04:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-11-02T04:04:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43592024-11-02T04:04:43.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43602024-11-02T04:04:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43612024-11-02T04:04:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43622024-11-02T04:04:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43632024-11-02T04:04:43.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43642024-11-02T04:04:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43652024-11-02T04:04:43.560ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43662024-11-02T04:04:43.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.502177ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43672024-11-02T04:04:43.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43682024-11-02T04:04:43.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43692024-11-02T04:04:43.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43702024-11-02T04:04:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43712024-11-02T04:04:43.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43722024-11-02T04:04:43.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43732024-11-02T04:04:43.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.633034ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43742024-11-02T04:04:43.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.874389ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43752024-11-02T04:04:43.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43762024-11-02T04:04:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43772024-11-02T04:04:43.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43782024-11-02T04:04:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43792024-11-02T04:04:43.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802024-11-02T04:04:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
43812024-11-02T04:04:43.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43822024-11-02T04:04:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43832024-11-02T04:04:43.603ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.222115ms iteration = 16 status = 0
43842024-11-02T04:04:43.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-11-02T04:04:43.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
43862024-11-02T04:04:43.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43872024-11-02T04:04:43.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43882024-11-02T04:04:43.624ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43892024-11-02T04:04:43.624ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43902024-11-02T04:04:43.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43912024-11-02T04:04:43.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43922024-11-02T04:04:43.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
43932024-11-02T04:04:43.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.598828ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
43942024-11-02T04:04:43.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
43952024-11-02T04:04:43.642ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43962024-11-02T04:04:43.643ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4777a0c-8299-4317-907d-cba6f29877c4", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
43972024-11-02T04:04:43.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43982024-11-02T04:04:43.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
43992024-11-02T04:04:43.656ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44002024-11-02T04:04:43.656ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44012024-11-02T04:04:43.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.649932ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44022024-11-02T04:04:43.668ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.411865ms iteration = 19 status = {"physical_disks_added":0}
44032024-11-02T04:04:43.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44042024-11-02T04:04:43.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44052024-11-02T04:04:43.730ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44062024-11-02T04:04:43.730ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44072024-11-02T04:04:43.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51e98904-3164-4a74-8e33-0e979d574d1e", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44082024-11-02T04:04:43.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44092024-11-02T04:04:43.732ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44102024-11-02T04:04:43.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44112024-11-02T04:04:43.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44122024-11-02T04:04:43.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53756763-0458-4450-b81b-ec5ac8471199", "content-length": "26", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44132024-11-02T04:04:43.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44142024-11-02T04:04:43.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44152024-11-02T04:04:43.779ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44162024-11-02T04:04:43.779ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44172024-11-02T04:04:43.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44182024-11-02T04:04:43.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44192024-11-02T04:04:43.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202024-11-02T04:04:43.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44212024-11-02T04:04:43.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44222024-11-02T04:04:43.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44232024-11-02T04:04:43.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-11-02T04:04:43.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44252024-11-02T04:04:43.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44262024-11-02T04:04:43.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44272024-11-02T04:04:43.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "91d0d67b-e138-41dd-8df3-f593b576ace1", "content-length": "372", "date": "Sat, 02 Nov 2024 04:04:42 GMT"} })
44282024-11-02T04:04:43.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44292024-11-02T04:04:43.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44302024-11-02T04:04:43.833ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44312024-11-02T04:04:43.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44322024-11-02T04:04:43.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "327ffc7a-e0b9-4908-9974-a2f04e69223e", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44332024-11-02T04:04:43.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44342024-11-02T04:04:43.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44352024-11-02T04:04:43.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44362024-11-02T04:04:43.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44372024-11-02T04:04:43.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44382024-11-02T04:04:43.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44392024-11-02T04:04:43.852ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44402024-11-02T04:04:43.852ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "74a4f2b7-8f5c-484d-a70e-647c37159737", "content-length": "1", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44412024-11-02T04:04:43.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44422024-11-02T04:04:43.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44432024-11-02T04:04:43.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44442024-11-02T04:04:43.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1c1272-43c7-4697-bc6b-1e06b240f5e7", "content-length": "691", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44452024-11-02T04:04:43.893ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44462024-11-02T04:04:43.893ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44472024-11-02T04:04:43.893ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44482024-11-02T04:04:43.894ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.985211ms iteration = 16 status = {}
44492024-11-02T04:04:43.894ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.132164ms iteration = 16 status = null
44502024-11-02T04:04:43.895ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44512024-11-02T04:04:43.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44522024-11-02T04:04:43.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d9093dd2-eefe-44f6-ac40-1b9858dcfaae", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44532024-11-02T04:04:43.897ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 355.509735ms iteration = 17 status = {}
44542024-11-02T04:04:43.930ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.282028ms iteration = 16 status = {}
44552024-11-02T04:04:43.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44562024-11-02T04:04:43.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44572024-11-02T04:04:43.963ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
44582024-11-02T04:04:43.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44592024-11-02T04:04:43.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44602024-11-02T04:04:43.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44612024-11-02T04:04:43.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "470b4469-5c06-4c68-89a4-7ec6e42d871c", "content-length": "134", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44622024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44632024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
44642024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44652024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44662024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44672024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44682024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44692024-11-02T04:04:43.975ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44702024-11-02T04:04:43.976ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44712024-11-02T04:04:43.976ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44722024-11-02T04:04:43.976ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
44732024-11-02T04:04:43.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44742024-11-02T04:04:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44752024-11-02T04:04:43.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44762024-11-02T04:04:43.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4f9c24f-8b5a-4236-bc91-aad48c4a880c", "content-length": "2", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44772024-11-02T04:04:43.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44782024-11-02T04:04:43.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ca1cab1-0187-4dea-8fce-18c86ff78036", "content-length": "52", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44792024-11-02T04:04:43.978ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
44802024-11-02T04:04:43.978ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44812024-11-02T04:04:44.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6402b312-6f8c-4480-8530-0a5d5ea2f7c4", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44822024-11-02T04:04:44.082ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
44832024-11-02T04:04:44.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44842024-11-02T04:04:44.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecebded7-0673-4996-b095-321d553d01b9", "content-length": "682", "date": "Sat, 02 Nov 2024 04:04:43 GMT"} })
44852024-11-02T04:04:44.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44862024-11-02T04:04:44.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44872024-11-02T04:04:44.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44882024-11-02T04:04:44.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44892024-11-02T04:04:44.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44902024-11-02T04:04:44.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44912024-11-02T04:04:44.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44922024-11-02T04:04:44.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44932024-11-02T04:04:44.099ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 557.555284ms iteration = 16 status = {}
44942024-11-02T04:04:44.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 06489966-0013-464b-bbaf-aa3c434c042b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44952024-11-02T04:04:44.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 06489966-0013-464b-bbaf-aa3c434c042b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44962024-11-02T04:04:44.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 06489966-0013-464b-bbaf-aa3c434c042b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44972024-11-02T04:04:44.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 600319cd-fba1-491f-91db-a1da2e37bc7e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
44982024-11-02T04:04:44.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 600319cd-fba1-491f-91db-a1da2e37bc7e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
44992024-11-02T04:04:44.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 600319cd-fba1-491f-91db-a1da2e37bc7e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45002024-11-02T04:04:45.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9cf2e52-b729-452a-b2b3-51f32aaa968d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45012024-11-02T04:04:45.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9cf2e52-b729-452a-b2b3-51f32aaa968d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45022024-11-02T04:04:45.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e9cf2e52-b729-452a-b2b3-51f32aaa968d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45032024-11-02T04:04:46.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8ec4d9-819d-41f7-8f84-fe31fca9e094 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45042024-11-02T04:04:46.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8ec4d9-819d-41f7-8f84-fe31fca9e094 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45052024-11-02T04:04:46.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8ec4d9-819d-41f7-8f84-fe31fca9e094 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45062024-11-02T04:04:47.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a502a482-323d-49d8-80eb-be86f6753791 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45072024-11-02T04:04:47.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a502a482-323d-49d8-80eb-be86f6753791 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45082024-11-02T04:04:47.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a502a482-323d-49d8-80eb-be86f6753791 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45092024-11-02T04:04:48.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f53e3625-28c6-43d8-87cf-186b15bbe67c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45102024-11-02T04:04:48.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f53e3625-28c6-43d8-87cf-186b15bbe67c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45112024-11-02T04:04:48.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f53e3625-28c6-43d8-87cf-186b15bbe67c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45122024-11-02T04:04:48.888ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:32879
45132024-11-02T04:04:48.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32879 req_id = c8659e45-52b8-4e2d-9040-2772d0807e5a roles = RoleSet { roles: {} } uri = /metrics/producers
45142024-11-02T04:04:48.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32879 req_id = c8659e45-52b8-4e2d-9040-2772d0807e5a resource = Database result = Ok(()) uri = /metrics/producers
45152024-11-02T04:04:48.926ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 6b8d67f3-a714-4683-8553-09335a4a9d26
45162024-11-02T04:04:48.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37986 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32879 req_id = c8659e45-52b8-4e2d-9040-2772d0807e5a response_code = 201 uri = /metrics/producers
45172024-11-02T04:04:49.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0396af64-a4b0-4475-82ab-bc8edad26d0f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45182024-11-02T04:04:49.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0396af64-a4b0-4475-82ab-bc8edad26d0f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45192024-11-02T04:04:49.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0396af64-a4b0-4475-82ab-bc8edad26d0f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45202024-11-02T04:04:50.562ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:51781
45212024-11-02T04:04:50.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51781 req_id = 39f00847-bece-4df8-bfdb-c9be36fc90d4 roles = RoleSet { roles: {} } uri = /metrics/producers
45222024-11-02T04:04:50.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51781 req_id = 39f00847-bece-4df8-bfdb-c9be36fc90d4 resource = Database result = Ok(()) uri = /metrics/producers
45232024-11-02T04:04:50.599ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = bbe1fec9-a47f-440b-bc9d-2726d77e81dc
45242024-11-02T04:04:50.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37134 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51781 req_id = 39f00847-bece-4df8-bfdb-c9be36fc90d4 response_code = 201 uri = /metrics/producers
45252024-11-02T04:04:50.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b549615-8e78-4cb8-96c2-3b6c68d62e15 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45262024-11-02T04:04:50.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b549615-8e78-4cb8-96c2-3b6c68d62e15 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45272024-11-02T04:04:50.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b549615-8e78-4cb8-96c2-3b6c68d62e15 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45282024-11-02T04:04:51.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d1ffe36-b605-4851-9e99-5a48bfe4aeaf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45292024-11-02T04:04:51.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d1ffe36-b605-4851-9e99-5a48bfe4aeaf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45302024-11-02T04:04:51.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4d1ffe36-b605-4851-9e99-5a48bfe4aeaf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45312024-11-02T04:04:51.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42459
45322024-11-02T04:04:51.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42459 req_id = 6165f2c6-078e-4f92-8704-2b42e2bdacac roles = RoleSet { roles: {} } uri = /metrics/producers
45332024-11-02T04:04:51.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42459 req_id = 6165f2c6-078e-4f92-8704-2b42e2bdacac resource = Database result = Ok(()) uri = /metrics/producers
45342024-11-02T04:04:51.933ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d565c44-21ca-41c0-b1d4-bcace41c9902
45352024-11-02T04:04:51.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11683 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42459 req_id = 6165f2c6-078e-4f92-8704-2b42e2bdacac response_code = 201 uri = /metrics/producers
45362024-11-02T04:04:51.990ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38409
45372024-11-02T04:04:51.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38409 req_id = 3ad3b135-5ebe-485f-a589-0baa13c8844b roles = RoleSet { roles: {} } uri = /metrics/producers
45382024-11-02T04:04:51.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38409 req_id = 3ad3b135-5ebe-485f-a589-0baa13c8844b resource = Database result = Ok(()) uri = /metrics/producers
45392024-11-02T04:04:52.027ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = df01f79b-0682-4f1b-aa97-1a8bb18b9157
45402024-11-02T04:04:52.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37470 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38409 req_id = 3ad3b135-5ebe-485f-a589-0baa13c8844b response_code = 201 uri = /metrics/producers
45412024-11-02T04:04:52.238ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41187
45422024-11-02T04:04:52.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41187 req_id = 2f79489b-3bd5-4e67-a7bb-dc52eaa71a82 roles = RoleSet { roles: {} } uri = /metrics/producers
45432024-11-02T04:04:52.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41187 req_id = 2f79489b-3bd5-4e67-a7bb-dc52eaa71a82 resource = Database result = Ok(()) uri = /metrics/producers
45442024-11-02T04:04:52.249ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 84e94f83-f18a-4122-a272-bfe20f1486da
45452024-11-02T04:04:52.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10739 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41187 req_id = 2f79489b-3bd5-4e67-a7bb-dc52eaa71a82 response_code = 201 uri = /metrics/producers
45462024-11-02T04:04:52.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98062803-40aa-47f2-b9ad-479d8bed2b7a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45472024-11-02T04:04:52.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98062803-40aa-47f2-b9ad-479d8bed2b7a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45482024-11-02T04:04:52.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98062803-40aa-47f2-b9ad-479d8bed2b7a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45492024-11-02T04:04:53.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
45502024-11-02T04:04:53.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45512024-11-02T04:04:53.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
45522024-11-02T04:04:53.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45532024-11-02T04:04:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45542024-11-02T04:04:53.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45552024-11-02T04:04:53.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45562024-11-02T04:04:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45572024-11-02T04:04:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-11-02T04:04:53.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.446223ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45592024-11-02T04:04:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45602024-11-02T04:04:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45612024-11-02T04:04:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45622024-11-02T04:04:53.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45632024-11-02T04:04:53.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45642024-11-02T04:04:53.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45652024-11-02T04:04:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
45662024-11-02T04:04:53.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45672024-11-02T04:04:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45682024-11-02T04:04:53.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
45692024-11-02T04:04:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.052931ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
45702024-11-02T04:04:53.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4a7e3c2-9917-454f-ba30-daeee2ea3f27 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45712024-11-02T04:04:53.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4a7e3c2-9917-454f-ba30-daeee2ea3f27 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45722024-11-02T04:04:53.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4a7e3c2-9917-454f-ba30-daeee2ea3f27 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45732024-11-02T04:04:53.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1527 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 7feb8830-2783-4c2b-abc4-6c8de483f9cb response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
45742024-11-02T04:04:54.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d25c0386-1ae8-4a6e-9dbd-94e1624b5c2b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45752024-11-02T04:04:54.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d25c0386-1ae8-4a6e-9dbd-94e1624b5c2b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45762024-11-02T04:04:54.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d25c0386-1ae8-4a6e-9dbd-94e1624b5c2b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45772024-11-02T04:04:55.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ba29ea7-aa5c-4144-9a83-3e1a1a950f36 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45782024-11-02T04:04:55.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ba29ea7-aa5c-4144-9a83-3e1a1a950f36 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45792024-11-02T04:04:55.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ba29ea7-aa5c-4144-9a83-3e1a1a950f36 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45802024-11-02T04:04:56.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1bfb4e31-babf-4f62-b2dc-8c6c4324375f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45812024-11-02T04:04:56.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1bfb4e31-babf-4f62-b2dc-8c6c4324375f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45822024-11-02T04:04:56.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1bfb4e31-babf-4f62-b2dc-8c6c4324375f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45832024-11-02T04:04:57.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66481682-7e46-479a-b3d6-132884429d5b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45842024-11-02T04:04:57.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66481682-7e46-479a-b3d6-132884429d5b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45852024-11-02T04:04:57.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66481682-7e46-479a-b3d6-132884429d5b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45862024-11-02T04:04:58.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb9b344-9e93-4717-8e6c-d1a955b2aea6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45872024-11-02T04:04:58.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb9b344-9e93-4717-8e6c-d1a955b2aea6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45882024-11-02T04:04:58.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = edb9b344-9e93-4717-8e6c-d1a955b2aea6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45892024-11-02T04:04:59.234ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:40022
45902024-11-02T04:04:59.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40022 req_id = 4dc536b1-3d5a-40ff-9a88-b64e4b9177f0 roles = RoleSet { roles: {} } uri = /metrics/producers
45912024-11-02T04:04:59.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40022 req_id = 4dc536b1-3d5a-40ff-9a88-b64e4b9177f0 resource = Database result = Ok(()) uri = /metrics/producers
45922024-11-02T04:04:59.245ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 5b8cdd5a-f021-45f2-8323-b6c8f9776060
45932024-11-02T04:04:59.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11216 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40022 req_id = 4dc536b1-3d5a-40ff-9a88-b64e4b9177f0 response_code = 201 uri = /metrics/producers
45942024-11-02T04:04:59.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0c39839e-dfda-4001-bac6-5f44dcd2005c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45952024-11-02T04:04:59.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0c39839e-dfda-4001-bac6-5f44dcd2005c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45962024-11-02T04:04:59.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0c39839e-dfda-4001-bac6-5f44dcd2005c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45972024-11-02T04:05:00.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e25e5ef0-9943-4ae8-bf92-a7f5f917d247 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45982024-11-02T04:05:00.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e25e5ef0-9943-4ae8-bf92-a7f5f917d247 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
45992024-11-02T04:05:00.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e25e5ef0-9943-4ae8-bf92-a7f5f917d247 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46002024-11-02T04:05:01.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3634e216-e665-4a75-9e92-e930ff6e03d1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46012024-11-02T04:05:01.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3634e216-e665-4a75-9e92-e930ff6e03d1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46022024-11-02T04:05:01.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3634e216-e665-4a75-9e92-e930ff6e03d1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46032024-11-02T04:05:02.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8966dbb2-8a36-4295-9767-121c593d973b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46042024-11-02T04:05:02.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8966dbb2-8a36-4295-9767-121c593d973b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46052024-11-02T04:05:02.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8966dbb2-8a36-4295-9767-121c593d973b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46062024-11-02T04:05:03.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
46072024-11-02T04:05:03.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46082024-11-02T04:05:03.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
46092024-11-02T04:05:03.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46102024-11-02T04:05:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46112024-11-02T04:05:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46122024-11-02T04:05:03.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46132024-11-02T04:05:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46142024-11-02T04:05:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46152024-11-02T04:05:03.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.370883ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46162024-11-02T04:05:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46172024-11-02T04:05:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46182024-11-02T04:05:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46192024-11-02T04:05:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46202024-11-02T04:05:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46212024-11-02T04:05:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222024-11-02T04:05:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
46232024-11-02T04:05:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46242024-11-02T04:05:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46252024-11-02T04:05:03.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
46262024-11-02T04:05:03.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.395691ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
46272024-11-02T04:05:03.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91fa861c-9c7e-47a1-ab3b-c90021afde74 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46282024-11-02T04:05:03.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91fa861c-9c7e-47a1-ab3b-c90021afde74 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46292024-11-02T04:05:03.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91fa861c-9c7e-47a1-ab3b-c90021afde74 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46302024-11-02T04:05:04.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 07fec8c6-6e5d-4880-8165-77d2ac539f5a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46312024-11-02T04:05:04.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 07fec8c6-6e5d-4880-8165-77d2ac539f5a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46322024-11-02T04:05:04.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 07fec8c6-6e5d-4880-8165-77d2ac539f5a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46332024-11-02T04:05:06.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9c65c2b9-70c9-48ab-9235-712a74f2f6ca roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46342024-11-02T04:05:06.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9c65c2b9-70c9-48ab-9235-712a74f2f6ca resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46352024-11-02T04:05:06.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9c65c2b9-70c9-48ab-9235-712a74f2f6ca response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46362024-11-02T04:05:07.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4afcdaf7-f579-4d70-9114-0ebdce0f797c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46372024-11-02T04:05:07.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4afcdaf7-f579-4d70-9114-0ebdce0f797c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46382024-11-02T04:05:07.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4afcdaf7-f579-4d70-9114-0ebdce0f797c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46392024-11-02T04:05:08.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b695cfc0-5d01-46a2-97ab-eab8a41a340c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46402024-11-02T04:05:08.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b695cfc0-5d01-46a2-97ab-eab8a41a340c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46412024-11-02T04:05:08.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b695cfc0-5d01-46a2-97ab-eab8a41a340c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46422024-11-02T04:05:08.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1309 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 673004bc-b42d-457c-8e9d-3918738f2231 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
46432024-11-02T04:05:09.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 508551c2-f9d0-415b-bbd9-3c22cc4376b0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46442024-11-02T04:05:09.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 508551c2-f9d0-415b-bbd9-3c22cc4376b0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46452024-11-02T04:05:09.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 508551c2-f9d0-415b-bbd9-3c22cc4376b0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46462024-11-02T04:05:10.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 419b3406-9f38-425c-8db5-e07bfbb4dac5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46472024-11-02T04:05:10.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 419b3406-9f38-425c-8db5-e07bfbb4dac5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46482024-11-02T04:05:10.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 419b3406-9f38-425c-8db5-e07bfbb4dac5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46492024-11-02T04:05:11.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee4cdb93-53d6-4be3-a666-20a90d040791 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46502024-11-02T04:05:11.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee4cdb93-53d6-4be3-a666-20a90d040791 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46512024-11-02T04:05:11.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee4cdb93-53d6-4be3-a666-20a90d040791 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46522024-11-02T04:05:12.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 039332cc-5aee-4642-8316-75850ca60d21 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46532024-11-02T04:05:12.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 039332cc-5aee-4642-8316-75850ca60d21 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46542024-11-02T04:05:12.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 039332cc-5aee-4642-8316-75850ca60d21 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46552024-11-02T04:05:13.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8fb5b69-d170-450f-89bf-de7af91aaaae roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46562024-11-02T04:05:13.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8fb5b69-d170-450f-89bf-de7af91aaaae resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46572024-11-02T04:05:13.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8fb5b69-d170-450f-89bf-de7af91aaaae response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
46582024-11-02T04:05:13.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d23e4468-480b-4fd2-a17f-7a8e45309d4a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46592024-11-02T04:05:13.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d23e4468-480b-4fd2-a17f-7a8e45309d4a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46602024-11-02T04:05:13.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d23e4468-480b-4fd2-a17f-7a8e45309d4a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46612024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
46622024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
46632024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46642024-11-02T04:05:13.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46652024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
46662024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46672024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46682024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
46692024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46702024-11-02T04:05:13.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
46712024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
46722024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46732024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46742024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
46752024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46762024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
46772024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46782024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46792024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
46802024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
46812024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46822024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
46832024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46842024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
46852024-11-02T04:05:13.542ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
46862024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
46872024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.56\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
46882024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
46892024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
46902024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46912024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46922024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
46932024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
46942024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
46952024-11-02T04:05:13.542ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
46962024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46972024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
46982024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
46992024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47002024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47012024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47022024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
47032024-11-02T04:05:13.542ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:55:13.542175304 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47042024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
47052024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47062024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
47072024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47082024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
47092024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47102024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47112024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47122024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47132024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47142024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47152024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47162024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47172024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47182024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47192024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47202024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47212024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47222024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47232024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47242024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
47252024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
47262024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
47272024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.91\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
47282024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.291\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47292024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
47302024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
47312024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47322024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
47332024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.21\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47342024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47352024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.24\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
47362024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47372024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47382024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47392024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47402024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47412024-11-02T04:05:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9817, tv_nsec: 519125433 } })
47422024-11-02T04:05:13.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9817, tv_nsec: 519125433 } })
47432024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
47442024-11-02T04:05:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47452024-11-02T04:05:13.543ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
47462024-11-02T04:05:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.205996ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
47472024-11-02T04:05:13.543ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
47482024-11-02T04:05:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.328779ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
47492024-11-02T04:05:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502024-11-02T04:05:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.220789ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47512024-11-02T04:05:13.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522024-11-02T04:05:13.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47532024-11-02T04:05:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47542024-11-02T04:05:13.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47552024-11-02T04:05:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47562024-11-02T04:05:13.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47572024-11-02T04:05:13.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47582024-11-02T04:05:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47592024-11-02T04:05:13.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47602024-11-02T04:05:13.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47612024-11-02T04:05:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47622024-11-02T04:05:13.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47632024-11-02T04:05:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47642024-11-02T04:05:13.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652024-11-02T04:05:13.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47662024-11-02T04:05:13.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9817, tv_nsec: 526842289 } })
47672024-11-02T04:05:13.550ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47682024-11-02T04:05:13.550ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47692024-11-02T04:05:13.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47702024-11-02T04:05:13.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
47712024-11-02T04:05:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47722024-11-02T04:05:13.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47732024-11-02T04:05:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47742024-11-02T04:05:13.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9817, tv_nsec: 527990653 } })
47752024-11-02T04:05:13.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
47762024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47772024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47782024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47792024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47802024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47812024-11-02T04:05:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47822024-11-02T04:05:13.555ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832024-11-02T04:05:13.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-11-02T04:05:13.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47852024-11-02T04:05:13.557ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:55:13.542175304 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
47862024-11-02T04:05:13.557ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.158286ms iteration = 9 status = {"expiration":"2024-11-02T03:55:13.542175304Z","pruned":[]}
47872024-11-02T04:05:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47882024-11-02T04:05:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47892024-11-02T04:05:13.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47902024-11-02T04:05:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47912024-11-02T04:05:13.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47922024-11-02T04:05:13.560ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.296892ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
47932024-11-02T04:05:13.561ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
47942024-11-02T04:05:13.561ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
47952024-11-02T04:05:13.561ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.834255ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
47962024-11-02T04:05:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47972024-11-02T04:05:13.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47982024-11-02T04:05:13.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992024-11-02T04:05:13.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9817, tv_nsec: 538410617 } })
48002024-11-02T04:05:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48012024-11-02T04:05:13.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
48022024-11-02T04:05:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48032024-11-02T04:05:13.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48042024-11-02T04:05:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48052024-11-02T04:05:13.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48062024-11-02T04:05:13.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48072024-11-02T04:05:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48082024-11-02T04:05:13.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48092024-11-02T04:05:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48102024-11-02T04:05:13.566ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48112024-11-02T04:05:13.566ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48122024-11-02T04:05:13.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48132024-11-02T04:05:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48142024-11-02T04:05:13.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48152024-11-02T04:05:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48162024-11-02T04:05:13.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48172024-11-02T04:05:13.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48182024-11-02T04:05:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48192024-11-02T04:05:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48202024-11-02T04:05:13.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48212024-11-02T04:05:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48222024-11-02T04:05:13.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48232024-11-02T04:05:13.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48242024-11-02T04:05:13.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48252024-11-02T04:05:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48262024-11-02T04:05:13.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48272024-11-02T04:05:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48282024-11-02T04:05:13.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48292024-11-02T04:05:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48302024-11-02T04:05:13.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48312024-11-02T04:05:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48322024-11-02T04:05:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48332024-11-02T04:05:13.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48342024-11-02T04:05:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48352024-11-02T04:05:13.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
48362024-11-02T04:05:13.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372024-11-02T04:05:13.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-11-02T04:05:13.619ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48392024-11-02T04:05:13.619ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48402024-11-02T04:05:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.680038ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48412024-11-02T04:05:13.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-11-02T04:05:13.620ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48432024-11-02T04:05:13.620ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
48442024-11-02T04:05:13.620ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.830033ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48452024-11-02T04:05:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
48462024-11-02T04:05:13.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48472024-11-02T04:05:13.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48482024-11-02T04:05:13.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.909998ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48492024-11-02T04:05:13.624ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48502024-11-02T04:05:13.624ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.298847ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48512024-11-02T04:05:13.653ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48522024-11-02T04:05:13.653ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48532024-11-02T04:05:13.653ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48542024-11-02T04:05:13.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48552024-11-02T04:05:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48562024-11-02T04:05:13.655ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48572024-11-02T04:05:13.655ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48582024-11-02T04:05:13.655ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48592024-11-02T04:05:13.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48602024-11-02T04:05:13.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48612024-11-02T04:05:13.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48622024-11-02T04:05:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48632024-11-02T04:05:13.672ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
48642024-11-02T04:05:13.672ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 130.663296ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48652024-11-02T04:05:13.689ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.945697ms iteration = 20 status = {"physical_disks_added":0}
48662024-11-02T04:05:13.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48672024-11-02T04:05:13.710ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48682024-11-02T04:05:13.710ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9032be1b-5376-43f0-b679-7aabb5505ef2", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
48692024-11-02T04:05:13.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48702024-11-02T04:05:13.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48712024-11-02T04:05:13.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48722024-11-02T04:05:13.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
48732024-11-02T04:05:13.727ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48742024-11-02T04:05:13.727ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f70630ed-8482-4ab2-8e2f-3ef28a73fbb8", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
48752024-11-02T04:05:13.728ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48762024-11-02T04:05:13.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
48772024-11-02T04:05:13.772ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48782024-11-02T04:05:13.772ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48792024-11-02T04:05:13.773ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2379ce9f-93a4-4f1a-9b7c-20834932d79e", "content-length": "372", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
48802024-11-02T04:05:13.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48812024-11-02T04:05:13.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48822024-11-02T04:05:13.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 232.511624ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48832024-11-02T04:05:13.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48842024-11-02T04:05:13.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48852024-11-02T04:05:13.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
48862024-11-02T04:05:13.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 244.93285ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
48872024-11-02T04:05:13.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48882024-11-02T04:05:13.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892024-11-02T04:05:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48902024-11-02T04:05:13.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48912024-11-02T04:05:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48922024-11-02T04:05:13.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48932024-11-02T04:05:13.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942024-11-02T04:05:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48952024-11-02T04:05:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48962024-11-02T04:05:13.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48972024-11-02T04:05:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48982024-11-02T04:05:13.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48992024-11-02T04:05:13.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49002024-11-02T04:05:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49012024-11-02T04:05:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
49022024-11-02T04:05:13.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49032024-11-02T04:05:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49042024-11-02T04:05:13.823ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 282.012196ms iteration = 17 status = 0
49052024-11-02T04:05:13.824ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
49062024-11-02T04:05:13.824ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49072024-11-02T04:05:13.824ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "48af9db6-fbb7-499d-9adc-f3984cc5984b", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
49082024-11-02T04:05:13.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49092024-11-02T04:05:13.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49102024-11-02T04:05:13.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49112024-11-02T04:05:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49122024-11-02T04:05:13.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49132024-11-02T04:05:13.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49142024-11-02T04:05:13.832ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49152024-11-02T04:05:13.832ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49162024-11-02T04:05:13.833ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf61f8c9-c0c1-49f3-b35a-b0c7870b3e5f", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
49172024-11-02T04:05:13.835ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.544324ms iteration = 18 status = {}
49182024-11-02T04:05:13.838ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49192024-11-02T04:05:13.838ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
49202024-11-02T04:05:13.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49212024-11-02T04:05:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49222024-11-02T04:05:13.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49232024-11-02T04:05:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49242024-11-02T04:05:13.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49252024-11-02T04:05:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49262024-11-02T04:05:13.845ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
49272024-11-02T04:05:13.845ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49282024-11-02T04:05:13.845ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
49292024-11-02T04:05:13.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.690023ms iteration = 10 status = {"generation":2}
49302024-11-02T04:05:13.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-11-02T04:05:13.849ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49322024-11-02T04:05:13.849ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49332024-11-02T04:05:13.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49342024-11-02T04:05:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49352024-11-02T04:05:13.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49362024-11-02T04:05:13.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49372024-11-02T04:05:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49382024-11-02T04:05:13.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49392024-11-02T04:05:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49402024-11-02T04:05:13.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49412024-11-02T04:05:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49422024-11-02T04:05:13.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432024-11-02T04:05:13.867ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
49442024-11-02T04:05:13.867ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49452024-11-02T04:05:13.867ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
49462024-11-02T04:05:13.867ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 325.819568ms iteration = 10 status = {"generation":1}
49472024-11-02T04:05:13.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49482024-11-02T04:05:13.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49492024-11-02T04:05:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49502024-11-02T04:05:13.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49512024-11-02T04:05:13.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
49522024-11-02T04:05:13.874ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49532024-11-02T04:05:13.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49542024-11-02T04:05:13.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49552024-11-02T04:05:13.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49562024-11-02T04:05:13.874ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e2e890-4ca0-4ac5-8e95-58dddc155790", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
49572024-11-02T04:05:13.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49582024-11-02T04:05:13.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49592024-11-02T04:05:13.902ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
49602024-11-02T04:05:13.903ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
49612024-11-02T04:05:13.904ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.082246ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49622024-11-02T04:05:13.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3ace3a50-1260-4941-9582-59abbaaf970c roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
49632024-11-02T04:05:13.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3ace3a50-1260-4941-9582-59abbaaf970c resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
49642024-11-02T04:05:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3ace3a50-1260-4941-9582-59abbaaf970c response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
49652024-11-02T04:05:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 47e13366-e795-48fe-9ab8-ceefd984ae00 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
49662024-11-02T04:05:13.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 47e13366-e795-48fe-9ab8-ceefd984ae00 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
49672024-11-02T04:05:13.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 47e13366-e795-48fe-9ab8-ceefd984ae00 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
49682024-11-02T04:05:13.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49692024-11-02T04:05:13.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e9399dc1-430b-4666-9eb9-e8eaeabcaf93", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49702024-11-02T04:05:13.997ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49712024-11-02T04:05:13.999ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "488b9480-ed75-448e-9d89-a0b1482ff505", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49722024-11-02T04:05:13.999ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49732024-11-02T04:05:14.001ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
49742024-11-02T04:05:14.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 459.767783ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49752024-11-02T04:05:14.020ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49762024-11-02T04:05:14.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "92dad6d8-a5bc-4adf-93fa-aba833595d52", "content-length": "1", "date": "Sat, 02 Nov 2024 04:05:14 GMT"} })
49772024-11-02T04:05:14.022ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49782024-11-02T04:05:14.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49792024-11-02T04:05:14.024ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 482.758958ms iteration = 17 status = null
49802024-11-02T04:05:14.033ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 491.942175ms iteration = 17 status = {}
49812024-11-02T04:05:14.053ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49822024-11-02T04:05:14.053ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d59466a7-d69c-4bea-9c70-9b4353a19b79", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49832024-11-02T04:05:14.053ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49842024-11-02T04:05:14.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "13f2a13b-e4e9-459f-93dd-50461b33a07c", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49852024-11-02T04:05:14.056ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49862024-11-02T04:05:14.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "aa9ad126-ba30-4ac0-a8e0-36031e274d31", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49872024-11-02T04:05:14.059ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49882024-11-02T04:05:14.061ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
49892024-11-02T04:05:14.061ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.135859ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49902024-11-02T04:05:14.070ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49912024-11-02T04:05:14.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49922024-11-02T04:05:14.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49932024-11-02T04:05:14.113ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "22fa6ea1-0213-4619-8f11-f63e51b8fd19", "content-length": "691", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
49942024-11-02T04:05:14.113ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49952024-11-02T04:05:14.113ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49962024-11-02T04:05:14.113ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49972024-11-02T04:05:14.114ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
49982024-11-02T04:05:14.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992024-11-02T04:05:14.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50002024-11-02T04:05:14.114ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 572.667029ms iteration = 17 status = {}
50012024-11-02T04:05:14.125ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50022024-11-02T04:05:14.125ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5efec455-f0b0-4600-977d-355630409f22", "content-length": "134", "date": "Sat, 02 Nov 2024 04:05:14 GMT"} })
50032024-11-02T04:05:14.125ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50042024-11-02T04:05:14.125ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
50052024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50062024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50072024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50082024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50092024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50102024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50112024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50122024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50132024-11-02T04:05:14.126ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
50142024-11-02T04:05:14.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50152024-11-02T04:05:14.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50162024-11-02T04:05:14.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50172024-11-02T04:05:14.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b5f6d07-e5f9-4d8d-a50f-9285be9d5265", "content-length": "2", "date": "Sat, 02 Nov 2024 04:05:14 GMT"} })
50182024-11-02T04:05:14.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50192024-11-02T04:05:14.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "96dedce1-3aaf-4445-89d0-e6c27a1e9b45", "content-length": "52", "date": "Sat, 02 Nov 2024 04:05:14 GMT"} })
50202024-11-02T04:05:14.128ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
50212024-11-02T04:05:14.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50222024-11-02T04:05:14.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ad6c3b03-1423-4aa1-838e-afcd566469f1", "date": "Sat, 02 Nov 2024 04:05:14 GMT"} })
50232024-11-02T04:05:14.228ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
50242024-11-02T04:05:14.228ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50252024-11-02T04:05:14.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a91e311e-331d-4001-b51c-3d2c85c57ea9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50262024-11-02T04:05:14.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a91e311e-331d-4001-b51c-3d2c85c57ea9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50272024-11-02T04:05:14.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "08b8fdd7-a06e-4408-ae31-44a27df70f16", "content-length": "682", "date": "Sat, 02 Nov 2024 04:05:13 GMT"} })
50282024-11-02T04:05:14.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50292024-11-02T04:05:14.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50302024-11-02T04:05:14.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a91e311e-331d-4001-b51c-3d2c85c57ea9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50312024-11-02T04:05:14.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50322024-11-02T04:05:14.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50332024-11-02T04:05:14.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50342024-11-02T04:05:14.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50352024-11-02T04:05:14.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50362024-11-02T04:05:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50372024-11-02T04:05:14.246ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.623462ms iteration = 17 status = {}
50382024-11-02T04:05:15.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7191d4c6-89d8-4fe2-bdb6-a9c0c136c097 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50392024-11-02T04:05:15.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7191d4c6-89d8-4fe2-bdb6-a9c0c136c097 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50402024-11-02T04:05:15.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7191d4c6-89d8-4fe2-bdb6-a9c0c136c097 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50412024-11-02T04:05:16.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4cfc4007-d6a6-4fed-a5e8-92e26b2d675e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50422024-11-02T04:05:16.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4cfc4007-d6a6-4fed-a5e8-92e26b2d675e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50432024-11-02T04:05:16.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4cfc4007-d6a6-4fed-a5e8-92e26b2d675e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50442024-11-02T04:05:17.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0760e4d-3e31-40d8-8901-e6cd42423f00 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50452024-11-02T04:05:17.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0760e4d-3e31-40d8-8901-e6cd42423f00 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50462024-11-02T04:05:17.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0760e4d-3e31-40d8-8901-e6cd42423f00 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50472024-11-02T04:05:18.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a704fc3-2a84-4aaf-9590-c4ba5ef83d97 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50482024-11-02T04:05:18.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a704fc3-2a84-4aaf-9590-c4ba5ef83d97 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50492024-11-02T04:05:18.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0a704fc3-2a84-4aaf-9590-c4ba5ef83d97 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50502024-11-02T04:05:19.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c75d206-c788-4440-8a40-12bb3683d004 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50512024-11-02T04:05:19.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c75d206-c788-4440-8a40-12bb3683d004 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50522024-11-02T04:05:19.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c75d206-c788-4440-8a40-12bb3683d004 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50532024-11-02T04:05:20.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 595405c8-3698-40fb-a1b1-fc2a2adf8315 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50542024-11-02T04:05:20.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 595405c8-3698-40fb-a1b1-fc2a2adf8315 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50552024-11-02T04:05:20.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 595405c8-3698-40fb-a1b1-fc2a2adf8315 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50562024-11-02T04:05:21.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0d05fdbd-d948-4d2a-9007-c4a9511f4b54 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50572024-11-02T04:05:21.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0d05fdbd-d948-4d2a-9007-c4a9511f4b54 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50582024-11-02T04:05:21.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0d05fdbd-d948-4d2a-9007-c4a9511f4b54 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50592024-11-02T04:05:22.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2054ea4b-f3d9-4455-9a1a-8de426de3b84 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50602024-11-02T04:05:22.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2054ea4b-f3d9-4455-9a1a-8de426de3b84 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50612024-11-02T04:05:22.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2054ea4b-f3d9-4455-9a1a-8de426de3b84 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50622024-11-02T04:05:23.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21183a74-8770-410d-9317-c65ce62f3a4c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50632024-11-02T04:05:23.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21183a74-8770-410d-9317-c65ce62f3a4c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50642024-11-02T04:05:23.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21183a74-8770-410d-9317-c65ce62f3a4c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50652024-11-02T04:05:23.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
50662024-11-02T04:05:23.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50672024-11-02T04:05:23.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
50682024-11-02T04:05:23.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50692024-11-02T04:05:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50702024-11-02T04:05:23.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50712024-11-02T04:05:23.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50722024-11-02T04:05:23.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50732024-11-02T04:05:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50742024-11-02T04:05:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50752024-11-02T04:05:23.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50762024-11-02T04:05:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50772024-11-02T04:05:23.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50782024-11-02T04:05:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50792024-11-02T04:05:23.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50802024-11-02T04:05:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
50812024-11-02T04:05:23.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50822024-11-02T04:05:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50832024-11-02T04:05:23.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
50842024-11-02T04:05:23.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.0574ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
50852024-11-02T04:05:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.633685ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50862024-11-02T04:05:23.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 08da34fe-6d51-4281-95ae-4188f230e0d2 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
50872024-11-02T04:05:24.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc35e1b3-4e36-47ac-b6db-f62f7c607f2e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50882024-11-02T04:05:24.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc35e1b3-4e36-47ac-b6db-f62f7c607f2e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50892024-11-02T04:05:24.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dc35e1b3-4e36-47ac-b6db-f62f7c607f2e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50902024-11-02T04:05:25.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16caa615-358b-4928-9a0c-fd3e1ad90c89 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50912024-11-02T04:05:25.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16caa615-358b-4928-9a0c-fd3e1ad90c89 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50922024-11-02T04:05:25.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16caa615-358b-4928-9a0c-fd3e1ad90c89 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50932024-11-02T04:05:26.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54196641-f1d9-4a04-a1ec-c7836de74cfd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50942024-11-02T04:05:26.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54196641-f1d9-4a04-a1ec-c7836de74cfd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50952024-11-02T04:05:26.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 54196641-f1d9-4a04-a1ec-c7836de74cfd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
50962024-11-02T04:05:27.513ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
50972024-11-02T04:05:27.513ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
50982024-11-02T04:05:27.544ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
50992024-11-02T04:05:27.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 302db6fe-840f-4c3e-a085-daa334bffdd8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51002024-11-02T04:05:27.544ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57179
51012024-11-02T04:05:27.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57179 req_id = 3389499c-58fb-45f8-878d-f67144f2891e roles = RoleSet { roles: {} } uri = /metrics/producers
51022024-11-02T04:05:27.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 302db6fe-840f-4c3e-a085-daa334bffdd8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51032024-11-02T04:05:27.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57179 req_id = 3389499c-58fb-45f8-878d-f67144f2891e resource = Database result = Ok(()) uri = /metrics/producers
51042024-11-02T04:05:27.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 302db6fe-840f-4c3e-a085-daa334bffdd8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51052024-11-02T04:05:27.583ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
51062024-11-02T04:05:27.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38750 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57179 req_id = 3389499c-58fb-45f8-878d-f67144f2891e response_code = 201 uri = /metrics/producers
51072024-11-02T04:05:27.583ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3389499c-58fb-45f8-878d-f67144f2891e", "content-length": "41", "date": "Sat, 02 Nov 2024 04:05:27 GMT"} })
51082024-11-02T04:05:27.584ZDEBGnexus (producer-registration-task): registered with nexus successfully
51092024-11-02T04:05:27.584ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
51102024-11-02T04:05:28.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 230de5eb-1ede-4763-8e6c-877feac4db91 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51112024-11-02T04:05:28.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 230de5eb-1ede-4763-8e6c-877feac4db91 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51122024-11-02T04:05:28.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 230de5eb-1ede-4763-8e6c-877feac4db91 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51132024-11-02T04:05:28.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 85898f47-8df6-42d5-a5a7-0924ec0ac9b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
51142024-11-02T04:05:28.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 85898f47-8df6-42d5-a5a7-0924ec0ac9b8 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
51152024-11-02T04:05:28.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 85898f47-8df6-42d5-a5a7-0924ec0ac9b8 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
51162024-11-02T04:05:28.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 301ac082-9057-4356-b1d3-17f1302fd5c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
51172024-11-02T04:05:28.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 301ac082-9057-4356-b1d3-17f1302fd5c8 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
51182024-11-02T04:05:28.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 301ac082-9057-4356-b1d3-17f1302fd5c8 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
51192024-11-02T04:05:29.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a81d7315-69ef-41cb-adf6-4448687eabd5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51202024-11-02T04:05:29.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a81d7315-69ef-41cb-adf6-4448687eabd5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51212024-11-02T04:05:29.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a81d7315-69ef-41cb-adf6-4448687eabd5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51222024-11-02T04:05:30.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56b98d8-3c55-4846-8585-b26d5ca35d91 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51232024-11-02T04:05:30.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56b98d8-3c55-4846-8585-b26d5ca35d91 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51242024-11-02T04:05:30.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f56b98d8-3c55-4846-8585-b26d5ca35d91 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51252024-11-02T04:05:31.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd4d6bb3-2373-4259-a62a-5909981bd809 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51262024-11-02T04:05:31.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd4d6bb3-2373-4259-a62a-5909981bd809 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51272024-11-02T04:05:31.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fd4d6bb3-2373-4259-a62a-5909981bd809 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51282024-11-02T04:05:32.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eecd91ca-5d35-4d1e-823d-f3ecdb56b8dd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51292024-11-02T04:05:32.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eecd91ca-5d35-4d1e-823d-f3ecdb56b8dd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51302024-11-02T04:05:32.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eecd91ca-5d35-4d1e-823d-f3ecdb56b8dd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51312024-11-02T04:05:33.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
51322024-11-02T04:05:33.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51332024-11-02T04:05:33.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
51342024-11-02T04:05:33.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51352024-11-02T04:05:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51362024-11-02T04:05:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51372024-11-02T04:05:33.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382024-11-02T04:05:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51392024-11-02T04:05:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51402024-11-02T04:05:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51412024-11-02T04:05:33.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51422024-11-02T04:05:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51432024-11-02T04:05:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442024-11-02T04:05:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
51452024-11-02T04:05:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51462024-11-02T04:05:33.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51472024-11-02T04:05:33.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
51482024-11-02T04:05:33.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.471879ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
51492024-11-02T04:05:33.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51502024-11-02T04:05:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51512024-11-02T04:05:33.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.354609ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51522024-11-02T04:05:33.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35bc7ad6-b60c-4f77-a622-7c6cf9ff35bc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51532024-11-02T04:05:33.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35bc7ad6-b60c-4f77-a622-7c6cf9ff35bc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51542024-11-02T04:05:33.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35bc7ad6-b60c-4f77-a622-7c6cf9ff35bc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51552024-11-02T04:05:34.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac7d1140-9766-4c30-86ac-69d981157a69 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51562024-11-02T04:05:34.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac7d1140-9766-4c30-86ac-69d981157a69 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51572024-11-02T04:05:34.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac7d1140-9766-4c30-86ac-69d981157a69 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51582024-11-02T04:05:35.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67c2cf03-1ab6-4987-aa77-81ccb1478a73 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51592024-11-02T04:05:35.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67c2cf03-1ab6-4987-aa77-81ccb1478a73 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51602024-11-02T04:05:35.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 67c2cf03-1ab6-4987-aa77-81ccb1478a73 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51612024-11-02T04:05:36.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89d481d1-c746-423c-8824-277bb73c8076 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51622024-11-02T04:05:36.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89d481d1-c746-423c-8824-277bb73c8076 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51632024-11-02T04:05:36.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89d481d1-c746-423c-8824-277bb73c8076 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51642024-11-02T04:05:37.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d3d7fb4-9359-485d-ac12-9440589ea116 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51652024-11-02T04:05:37.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d3d7fb4-9359-485d-ac12-9440589ea116 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51662024-11-02T04:05:37.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d3d7fb4-9359-485d-ac12-9440589ea116 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51672024-11-02T04:05:38.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f182c13f-96ad-4bb4-939b-4e54fb51eb15 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51682024-11-02T04:05:38.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f182c13f-96ad-4bb4-939b-4e54fb51eb15 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51692024-11-02T04:05:38.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f182c13f-96ad-4bb4-939b-4e54fb51eb15 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51702024-11-02T04:05:38.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1669 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = b1645494-675e-41a2-a211-6e5c7eb88944 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
51712024-11-02T04:05:39.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b12c44c-16a1-4a48-a799-0f23f441761b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51722024-11-02T04:05:39.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b12c44c-16a1-4a48-a799-0f23f441761b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51732024-11-02T04:05:39.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b12c44c-16a1-4a48-a799-0f23f441761b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51742024-11-02T04:05:40.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 931d55a3-a993-45b4-8458-fa67120a52d8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51752024-11-02T04:05:40.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 931d55a3-a993-45b4-8458-fa67120a52d8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51762024-11-02T04:05:40.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 931d55a3-a993-45b4-8458-fa67120a52d8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51772024-11-02T04:05:41.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 058d3733-e24e-4a6f-8cbe-f39e3086521f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51782024-11-02T04:05:41.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 058d3733-e24e-4a6f-8cbe-f39e3086521f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51792024-11-02T04:05:41.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 058d3733-e24e-4a6f-8cbe-f39e3086521f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51802024-11-02T04:05:42.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dc39920-d2a8-4902-9189-3d4526ec6bc6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51812024-11-02T04:05:42.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dc39920-d2a8-4902-9189-3d4526ec6bc6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51822024-11-02T04:05:42.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dc39920-d2a8-4902-9189-3d4526ec6bc6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
51832024-11-02T04:05:43.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 70b0bf1d-ac1a-4f5e-b4f9-ea5218430638 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51842024-11-02T04:05:43.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 70b0bf1d-ac1a-4f5e-b4f9-ea5218430638 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51852024-11-02T04:05:43.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 70b0bf1d-ac1a-4f5e-b4f9-ea5218430638 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51862024-11-02T04:05:43.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
51872024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51882024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
51892024-11-02T04:05:43.542ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51902024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
51912024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51922024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
51932024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51942024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51952024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51962024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
51972024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
51982024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51992024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52002024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
52012024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
52022024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52032024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
52042024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52052024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52062024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
52072024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
52082024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52092024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52102024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
52112024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
52122024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52132024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52142024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52152024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52162024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52172024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52182024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52192024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52202024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52212024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52222024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52232024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52242024-11-02T04:05:43.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52252024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
52262024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
52272024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.44\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
52282024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
52292024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.67\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
52302024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
52312024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.89\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52322024-11-02T04:05:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.941\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52332024-11-02T04:05:43.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342024-11-02T04:05:43.545ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52352024-11-02T04:05:43.545ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52362024-11-02T04:05:43.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52372024-11-02T04:05:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52382024-11-02T04:05:43.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.275512ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52392024-11-02T04:05:43.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52402024-11-02T04:05:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52412024-11-02T04:05:43.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52422024-11-02T04:05:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52432024-11-02T04:05:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52442024-11-02T04:05:43.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52452024-11-02T04:05:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52462024-11-02T04:05:43.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52472024-11-02T04:05:43.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9847, tv_nsec: 526610583 } })
52482024-11-02T04:05:43.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9847, tv_nsec: 526744816 } })
52492024-11-02T04:05:43.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
52502024-11-02T04:05:43.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
52512024-11-02T04:05:43.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52522024-11-02T04:05:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52532024-11-02T04:05:43.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52542024-11-02T04:05:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52552024-11-02T04:05:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52562024-11-02T04:05:43.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9847, tv_nsec: 529740090 } })
52572024-11-02T04:05:43.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
52582024-11-02T04:05:43.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52592024-11-02T04:05:43.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602024-11-02T04:05:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52612024-11-02T04:05:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52622024-11-02T04:05:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52632024-11-02T04:05:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52642024-11-02T04:05:43.578ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52652024-11-02T04:05:43.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52662024-11-02T04:05:43.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-11-02T04:05:43.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52682024-11-02T04:05:43.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52692024-11-02T04:05:43.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52702024-11-02T04:05:43.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712024-11-02T04:05:43.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52722024-11-02T04:05:43.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52732024-11-02T04:05:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52742024-11-02T04:05:43.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52752024-11-02T04:05:43.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-11-02T04:05:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52772024-11-02T04:05:43.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-11-02T04:05:43.596ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52792024-11-02T04:05:43.596ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52802024-11-02T04:05:43.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52812024-11-02T04:05:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52822024-11-02T04:05:43.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52832024-11-02T04:05:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52842024-11-02T04:05:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52852024-11-02T04:05:43.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52862024-11-02T04:05:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52872024-11-02T04:05:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52882024-11-02T04:05:43.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52892024-11-02T04:05:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52902024-11-02T04:05:43.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52912024-11-02T04:05:43.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52922024-11-02T04:05:43.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52932024-11-02T04:05:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52942024-11-02T04:05:43.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.865799ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52952024-11-02T04:05:43.632ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52962024-11-02T04:05:43.632ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52972024-11-02T04:05:43.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.262198ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52982024-11-02T04:05:43.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.382728ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52992024-11-02T04:05:43.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53002024-11-02T04:05:43.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
53012024-11-02T04:05:43.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53022024-11-02T04:05:43.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53032024-11-02T04:05:43.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042024-11-02T04:05:43.644ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.322087ms iteration = 18 status = 0
53052024-11-02T04:05:43.645ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53062024-11-02T04:05:43.645ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.303509ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53072024-11-02T04:05:43.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
53082024-11-02T04:05:43.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53092024-11-02T04:05:43.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abd0746c-a0a1-44c7-80e6-a5d1c9383f58", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53102024-11-02T04:05:43.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53112024-11-02T04:05:43.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
53122024-11-02T04:05:43.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53132024-11-02T04:05:43.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53142024-11-02T04:05:43.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
53152024-11-02T04:05:43.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53162024-11-02T04:05:43.650ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53172024-11-02T04:05:43.650ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6ea7a0e-5a6c-4a8e-b0db-e34bb067c6fc", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53182024-11-02T04:05:43.650ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53192024-11-02T04:05:43.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53202024-11-02T04:05:43.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53212024-11-02T04:05:43.655ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53222024-11-02T04:05:43.655ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2d071b4-7ee5-4e41-9a43-f376cada347a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53232024-11-02T04:05:43.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53242024-11-02T04:05:43.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53252024-11-02T04:05:43.659ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
53262024-11-02T04:05:43.659ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.448773ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
53272024-11-02T04:05:43.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53282024-11-02T04:05:43.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53292024-11-02T04:05:43.695ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.104769ms iteration = 21 status = {"physical_disks_added":0}
53302024-11-02T04:05:43.769ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53312024-11-02T04:05:43.769ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c6ddf22-adb6-4f06-871a-d8d815b7bcad", "content-length": "1", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53322024-11-02T04:05:43.773ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53332024-11-02T04:05:43.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53342024-11-02T04:05:43.777ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 235.390635ms iteration = 18 status = null
53352024-11-02T04:05:43.784ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 241.952466ms iteration = 18 status = {}
53362024-11-02T04:05:43.788ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53372024-11-02T04:05:43.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53382024-11-02T04:05:43.788ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d6d75aa-2f3f-49cb-9219-770e713bd4ca", "content-length": "372", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53392024-11-02T04:05:43.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53402024-11-02T04:05:43.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53412024-11-02T04:05:43.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53422024-11-02T04:05:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53432024-11-02T04:05:43.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53442024-11-02T04:05:43.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53452024-11-02T04:05:43.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53462024-11-02T04:05:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53472024-11-02T04:05:43.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53482024-11-02T04:05:43.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53492024-11-02T04:05:43.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53502024-11-02T04:05:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53512024-11-02T04:05:43.846ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53522024-11-02T04:05:43.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53532024-11-02T04:05:43.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53542024-11-02T04:05:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53552024-11-02T04:05:43.853ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
53562024-11-02T04:05:43.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53572024-11-02T04:05:43.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53582024-11-02T04:05:43.867ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53592024-11-02T04:05:43.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1681c86e-6bdf-4d0f-be46-62e05e7f75ad", "content-length": "134", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53602024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53612024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
53622024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53632024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53642024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53652024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53662024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53672024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53682024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53692024-11-02T04:05:43.868ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53702024-11-02T04:05:43.869ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
53712024-11-02T04:05:43.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53722024-11-02T04:05:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53732024-11-02T04:05:43.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53742024-11-02T04:05:43.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c5dffac-86db-4ef4-b3ec-7e13aab15583", "content-length": "2", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53752024-11-02T04:05:43.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53762024-11-02T04:05:43.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "db65aa17-042c-4757-a11f-da04426f330f", "content-length": "52", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53772024-11-02T04:05:43.872ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
53782024-11-02T04:05:43.872ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53792024-11-02T04:05:43.952ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53802024-11-02T04:05:43.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78302651-b81d-4399-99c8-318850b3af9a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
53812024-11-02T04:05:43.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78302651-b81d-4399-99c8-318850b3af9a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
53822024-11-02T04:05:43.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d1c93e-dc8f-48c0-aee9-5a8525cdc336", "content-length": "691", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53832024-11-02T04:05:43.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27fd87d3-b1a7-4850-aff2-f914d19e2a09", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53842024-11-02T04:05:43.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53852024-11-02T04:05:43.970ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53862024-11-02T04:05:43.970ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53872024-11-02T04:05:43.970ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53882024-11-02T04:05:43.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53892024-11-02T04:05:43.971ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 429.683208ms iteration = 18 status = {}
53902024-11-02T04:05:43.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53912024-11-02T04:05:43.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78302651-b81d-4399-99c8-318850b3af9a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
53922024-11-02T04:05:43.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53932024-11-02T04:05:43.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53942024-11-02T04:05:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53952024-11-02T04:05:43.980ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53962024-11-02T04:05:43.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53972024-11-02T04:05:43.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0cee0ce2-3691-458e-a08e-b0eb090763f1", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
53982024-11-02T04:05:43.983ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.535453ms iteration = 19 status = {}
53992024-11-02T04:05:44.076ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "94d44ff2-77e8-4fe4-8c75-1531e83db5d7", "date": "Sat, 02 Nov 2024 04:05:44 GMT"} })
54002024-11-02T04:05:44.076ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
54012024-11-02T04:05:44.076ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54022024-11-02T04:05:44.076ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b49a7400-11f7-4381-bb94-f5189207ed31", "content-length": "682", "date": "Sat, 02 Nov 2024 04:05:43 GMT"} })
54032024-11-02T04:05:44.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54042024-11-02T04:05:44.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54052024-11-02T04:05:44.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54062024-11-02T04:05:44.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54072024-11-02T04:05:44.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54082024-11-02T04:05:44.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54092024-11-02T04:05:44.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54102024-11-02T04:05:44.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54112024-11-02T04:05:44.092ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.561703ms iteration = 18 status = {}
54122024-11-02T04:05:44.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1688d2b8-4638-440f-bded-11f128d98fd4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54132024-11-02T04:05:44.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1688d2b8-4638-440f-bded-11f128d98fd4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54142024-11-02T04:05:44.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1688d2b8-4638-440f-bded-11f128d98fd4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54152024-11-02T04:05:46.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6094fe70-9a35-4b78-b8a6-136039a6fcfd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54162024-11-02T04:05:46.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6094fe70-9a35-4b78-b8a6-136039a6fcfd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54172024-11-02T04:05:46.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6094fe70-9a35-4b78-b8a6-136039a6fcfd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54182024-11-02T04:05:47.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03744c8f-ea87-46a1-b1a6-3ea7e6af0b6e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54192024-11-02T04:05:47.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03744c8f-ea87-46a1-b1a6-3ea7e6af0b6e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54202024-11-02T04:05:47.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03744c8f-ea87-46a1-b1a6-3ea7e6af0b6e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54212024-11-02T04:05:48.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd8ef512-d854-4583-ba31-a4246bdad9f4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54222024-11-02T04:05:48.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd8ef512-d854-4583-ba31-a4246bdad9f4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54232024-11-02T04:05:48.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd8ef512-d854-4583-ba31-a4246bdad9f4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54242024-11-02T04:05:49.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 29fa6b24-2226-4381-be79-bc73aaa6ffea roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54252024-11-02T04:05:49.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 29fa6b24-2226-4381-be79-bc73aaa6ffea resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54262024-11-02T04:05:49.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 29fa6b24-2226-4381-be79-bc73aaa6ffea response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54272024-11-02T04:05:50.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 81b6c3a5-db72-40f2-82f4-f5cc07bc4452 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54282024-11-02T04:05:50.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 81b6c3a5-db72-40f2-82f4-f5cc07bc4452 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54292024-11-02T04:05:50.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 81b6c3a5-db72-40f2-82f4-f5cc07bc4452 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54302024-11-02T04:05:51.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b1ac5885-50b6-48fe-a8d7-a803f362baf8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54312024-11-02T04:05:51.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b1ac5885-50b6-48fe-a8d7-a803f362baf8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54322024-11-02T04:05:51.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b1ac5885-50b6-48fe-a8d7-a803f362baf8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54332024-11-02T04:05:52.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e6c63b9-ea0a-477e-a216-865b0ed2cc9e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54342024-11-02T04:05:52.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e6c63b9-ea0a-477e-a216-865b0ed2cc9e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54352024-11-02T04:05:52.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e6c63b9-ea0a-477e-a216-865b0ed2cc9e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54362024-11-02T04:05:53.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e3448b9-7e55-4f56-8eb1-5bab104d5265 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54372024-11-02T04:05:53.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e3448b9-7e55-4f56-8eb1-5bab104d5265 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54382024-11-02T04:05:53.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7e3448b9-7e55-4f56-8eb1-5bab104d5265 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54392024-11-02T04:05:53.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
54402024-11-02T04:05:53.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54412024-11-02T04:05:53.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
54422024-11-02T04:05:53.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54432024-11-02T04:05:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-11-02T04:05:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54452024-11-02T04:05:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54462024-11-02T04:05:53.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54472024-11-02T04:05:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54482024-11-02T04:05:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54492024-11-02T04:05:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502024-11-02T04:05:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512024-11-02T04:05:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54522024-11-02T04:05:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54532024-11-02T04:05:53.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-11-02T04:05:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
54552024-11-02T04:05:53.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54562024-11-02T04:05:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54572024-11-02T04:05:53.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
54582024-11-02T04:05:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.124246ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
54592024-11-02T04:05:53.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.168798ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54602024-11-02T04:05:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1340 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 9e67c503-3c1d-4711-9893-bed7fb374c57 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
54612024-11-02T04:05:54.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c7e3bb4-159b-4363-accf-2880b2db42a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54622024-11-02T04:05:54.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c7e3bb4-159b-4363-accf-2880b2db42a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54632024-11-02T04:05:54.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c7e3bb4-159b-4363-accf-2880b2db42a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54642024-11-02T04:05:55.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 142df2b3-15f1-455a-815c-14810b61b9e4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54652024-11-02T04:05:55.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 142df2b3-15f1-455a-815c-14810b61b9e4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54662024-11-02T04:05:55.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 142df2b3-15f1-455a-815c-14810b61b9e4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54672024-11-02T04:05:56.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8b5f232-4ead-4f2f-a5cd-0c9c526a44e7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54682024-11-02T04:05:56.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8b5f232-4ead-4f2f-a5cd-0c9c526a44e7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54692024-11-02T04:05:56.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8b5f232-4ead-4f2f-a5cd-0c9c526a44e7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54702024-11-02T04:05:57.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052a2a91-e9a0-4a0a-9518-51ba2e313829 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54712024-11-02T04:05:57.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052a2a91-e9a0-4a0a-9518-51ba2e313829 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54722024-11-02T04:05:57.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052a2a91-e9a0-4a0a-9518-51ba2e313829 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54732024-11-02T04:05:58.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e07563cb-d9b0-4899-bf6a-92d613fbfe19 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54742024-11-02T04:05:58.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e07563cb-d9b0-4899-bf6a-92d613fbfe19 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54752024-11-02T04:05:58.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e07563cb-d9b0-4899-bf6a-92d613fbfe19 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54762024-11-02T04:05:58.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = a7c728b2-a3a0-4017-9ca4-85fce2dab573 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
54772024-11-02T04:05:58.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = a7c728b2-a3a0-4017-9ca4-85fce2dab573 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
54782024-11-02T04:05:58.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = a7c728b2-a3a0-4017-9ca4-85fce2dab573 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
54792024-11-02T04:05:58.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 93c2c7cf-ee83-4380-a553-ce691e9a2256 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
54802024-11-02T04:05:58.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 93c2c7cf-ee83-4380-a553-ce691e9a2256 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
54812024-11-02T04:05:58.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 93c2c7cf-ee83-4380-a553-ce691e9a2256 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
54822024-11-02T04:05:59.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 724a028e-c981-4b12-8b44-c3bdb7b8cc62 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54832024-11-02T04:05:59.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 724a028e-c981-4b12-8b44-c3bdb7b8cc62 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54842024-11-02T04:05:59.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 724a028e-c981-4b12-8b44-c3bdb7b8cc62 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54852024-11-02T04:06:00.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a71f4a9-b78a-46bb-bd3a-39efd506b387 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54862024-11-02T04:06:00.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a71f4a9-b78a-46bb-bd3a-39efd506b387 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54872024-11-02T04:06:00.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a71f4a9-b78a-46bb-bd3a-39efd506b387 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54882024-11-02T04:06:01.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39340aa9-aff0-4134-acbd-991d9c22f650 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54892024-11-02T04:06:01.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39340aa9-aff0-4134-acbd-991d9c22f650 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54902024-11-02T04:06:01.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39340aa9-aff0-4134-acbd-991d9c22f650 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54912024-11-02T04:06:02.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b55272b-3be4-47e7-a383-3b6c0bab6605 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54922024-11-02T04:06:02.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b55272b-3be4-47e7-a383-3b6c0bab6605 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54932024-11-02T04:06:02.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b55272b-3be4-47e7-a383-3b6c0bab6605 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54942024-11-02T04:06:03.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 603b94a6-8592-446d-849c-9e9c4290b8c7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54952024-11-02T04:06:03.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 603b94a6-8592-446d-849c-9e9c4290b8c7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54962024-11-02T04:06:03.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 603b94a6-8592-446d-849c-9e9c4290b8c7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
54972024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
54982024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54992024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
55002024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55012024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55022024-11-02T04:06:03.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55032024-11-02T04:06:03.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-11-02T04:06:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55052024-11-02T04:06:03.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55062024-11-02T04:06:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55072024-11-02T04:06:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55082024-11-02T04:06:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55092024-11-02T04:06:03.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102024-11-02T04:06:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
55112024-11-02T04:06:03.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55122024-11-02T04:06:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55132024-11-02T04:06:03.567ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
55142024-11-02T04:06:03.567ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.643571ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
55152024-11-02T04:06:03.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55162024-11-02T04:06:03.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55172024-11-02T04:06:03.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.917341ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55182024-11-02T04:06:04.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d959b69c-5f8e-433b-a63a-a23dc84ba6c8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55192024-11-02T04:06:04.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d959b69c-5f8e-433b-a63a-a23dc84ba6c8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55202024-11-02T04:06:04.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d959b69c-5f8e-433b-a63a-a23dc84ba6c8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55212024-11-02T04:06:05.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0871e5b0-9fcb-45d6-9f78-c7d90d2279e3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55222024-11-02T04:06:05.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0871e5b0-9fcb-45d6-9f78-c7d90d2279e3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55232024-11-02T04:06:05.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0871e5b0-9fcb-45d6-9f78-c7d90d2279e3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55242024-11-02T04:06:06.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffd01ced-9dbf-4e14-b14b-8efd1eb3b239 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55252024-11-02T04:06:06.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffd01ced-9dbf-4e14-b14b-8efd1eb3b239 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55262024-11-02T04:06:06.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffd01ced-9dbf-4e14-b14b-8efd1eb3b239 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55272024-11-02T04:06:07.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e1423d7-d188-412f-83c1-04e0ddf08483 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55282024-11-02T04:06:07.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e1423d7-d188-412f-83c1-04e0ddf08483 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55292024-11-02T04:06:07.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e1423d7-d188-412f-83c1-04e0ddf08483 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55302024-11-02T04:06:08.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca081280-1fde-45a8-8fd5-1143c2c489da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55312024-11-02T04:06:08.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca081280-1fde-45a8-8fd5-1143c2c489da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55322024-11-02T04:06:08.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca081280-1fde-45a8-8fd5-1143c2c489da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55332024-11-02T04:06:08.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1369 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 11125417-ef90-47b4-8868-4090c5c146a6 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
55342024-11-02T04:06:09.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac059193-36f0-4220-bd5c-82c1faefc303 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55352024-11-02T04:06:09.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac059193-36f0-4220-bd5c-82c1faefc303 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55362024-11-02T04:06:09.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ac059193-36f0-4220-bd5c-82c1faefc303 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55372024-11-02T04:06:10.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7857fae3-76c5-4258-85e2-ae93ee711db2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55382024-11-02T04:06:10.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7857fae3-76c5-4258-85e2-ae93ee711db2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55392024-11-02T04:06:10.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7857fae3-76c5-4258-85e2-ae93ee711db2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55402024-11-02T04:06:11.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a7268d8-5bcd-48dd-8802-db7b882bc201 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55412024-11-02T04:06:11.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a7268d8-5bcd-48dd-8802-db7b882bc201 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55422024-11-02T04:06:11.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a7268d8-5bcd-48dd-8802-db7b882bc201 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55432024-11-02T04:06:12.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 255087e0-64e1-4f4d-9e28-9238d071ef6f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55442024-11-02T04:06:12.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 255087e0-64e1-4f4d-9e28-9238d071ef6f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55452024-11-02T04:06:12.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 255087e0-64e1-4f4d-9e28-9238d071ef6f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
55462024-11-02T04:06:13.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d37d7dad-30ce-4010-94eb-e29a04687933 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55472024-11-02T04:06:13.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d37d7dad-30ce-4010-94eb-e29a04687933 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55482024-11-02T04:06:13.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = d37d7dad-30ce-4010-94eb-e29a04687933 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55492024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
55502024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
55512024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
55522024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55532024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
55542024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55552024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
55562024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
55572024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
55582024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55592024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55602024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
55612024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
55622024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55632024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
55642024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
55652024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55662024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
55672024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
55682024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55692024-11-02T04:06:13.542ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
55702024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55712024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
55722024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
55732024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
55742024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
55752024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55762024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
55772024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55782024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55792024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55802024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
55812024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
55822024-11-02T04:06:13.542ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55832024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55842024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55852024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55862024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
55872024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55882024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
55892024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
55902024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55912024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
55922024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55932024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
55942024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
55952024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55962024-11-02T04:06:13.542ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
55972024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
55982024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.59\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
55992024-11-02T04:06:13.542ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:56:13.542682374 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56002024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56012024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56022024-11-02T04:06:13.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56032024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56042024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56052024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56062024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56072024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56082024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56092024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56102024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56112024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56122024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56132024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56142024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56152024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56162024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56172024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56182024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56192024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
56202024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
56212024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.16\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
56222024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
56232024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
56242024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.04\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56252024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56262024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56272024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.83\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56282024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56292024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
56302024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.169\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
56312024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
56322024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56332024-11-02T04:06:13.543ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9877, tv_nsec: 519243445 } })
56342024-11-02T04:06:13.543ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9877, tv_nsec: 519262755 } })
56352024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56362024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56372024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56382024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56392024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56402024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56412024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
56422024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.418741ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
56432024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56442024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56452024-11-02T04:06:13.543ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
56462024-11-02T04:06:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.39294ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
56472024-11-02T04:06:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56482024-11-02T04:06:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56492024-11-02T04:06:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56502024-11-02T04:06:13.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56512024-11-02T04:06:13.547ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.587389ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56522024-11-02T04:06:13.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56532024-11-02T04:06:13.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56542024-11-02T04:06:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56552024-11-02T04:06:13.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56562024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56572024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56582024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56592024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56602024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56612024-11-02T04:06:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622024-11-02T04:06:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56632024-11-02T04:06:13.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56642024-11-02T04:06:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56652024-11-02T04:06:13.553ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662024-11-02T04:06:13.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56672024-11-02T04:06:13.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56692024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56702024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56712024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56722024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56732024-11-02T04:06:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56742024-11-02T04:06:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56752024-11-02T04:06:13.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56762024-11-02T04:06:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56772024-11-02T04:06:13.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9877, tv_nsec: 535831311 } })
56782024-11-02T04:06:13.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
56792024-11-02T04:06:13.561ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:56:13.542682374 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56802024-11-02T04:06:13.561ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.330214ms iteration = 10 status = {"expiration":"2024-11-02T03:56:13.542682374Z","pruned":[]}
56812024-11-02T04:06:13.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9877, tv_nsec: 537971327 } })
56822024-11-02T04:06:13.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
56832024-11-02T04:06:13.562ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.490438ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
56842024-11-02T04:06:13.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852024-11-02T04:06:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56862024-11-02T04:06:13.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56872024-11-02T04:06:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56882024-11-02T04:06:13.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56892024-11-02T04:06:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56902024-11-02T04:06:13.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56912024-11-02T04:06:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56922024-11-02T04:06:13.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932024-11-02T04:06:13.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56942024-11-02T04:06:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56952024-11-02T04:06:13.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9877, tv_nsec: 550300592 } })
56962024-11-02T04:06:13.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
56972024-11-02T04:06:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56982024-11-02T04:06:13.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56992024-11-02T04:06:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57002024-11-02T04:06:13.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57012024-11-02T04:06:13.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57022024-11-02T04:06:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57032024-11-02T04:06:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57042024-11-02T04:06:13.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57052024-11-02T04:06:13.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57062024-11-02T04:06:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
57072024-11-02T04:06:13.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082024-11-02T04:06:13.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092024-11-02T04:06:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57102024-11-02T04:06:13.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57112024-11-02T04:06:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57122024-11-02T04:06:13.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57132024-11-02T04:06:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57142024-11-02T04:06:13.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57152024-11-02T04:06:13.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57162024-11-02T04:06:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57172024-11-02T04:06:13.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57182024-11-02T04:06:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57192024-11-02T04:06:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57202024-11-02T04:06:13.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57212024-11-02T04:06:13.599ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.738399ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57222024-11-02T04:06:13.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57232024-11-02T04:06:13.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57242024-11-02T04:06:13.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57252024-11-02T04:06:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57262024-11-02T04:06:13.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57272024-11-02T04:06:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57282024-11-02T04:06:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57292024-11-02T04:06:13.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57302024-11-02T04:06:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57312024-11-02T04:06:13.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322024-11-02T04:06:13.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
57332024-11-02T04:06:13.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.244959ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
57342024-11-02T04:06:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57352024-11-02T04:06:13.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57362024-11-02T04:06:13.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57372024-11-02T04:06:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57382024-11-02T04:06:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57392024-11-02T04:06:13.609ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57402024-11-02T04:06:13.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57412024-11-02T04:06:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57422024-11-02T04:06:13.610ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57432024-11-02T04:06:13.610ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57442024-11-02T04:06:13.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57452024-11-02T04:06:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57462024-11-02T04:06:13.611ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
57472024-11-02T04:06:13.611ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
57482024-11-02T04:06:13.611ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.996481ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
57492024-11-02T04:06:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57502024-11-02T04:06:13.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57512024-11-02T04:06:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57522024-11-02T04:06:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57532024-11-02T04:06:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57542024-11-02T04:06:13.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57552024-11-02T04:06:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57562024-11-02T04:06:13.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57572024-11-02T04:06:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57582024-11-02T04:06:13.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57592024-11-02T04:06:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57602024-11-02T04:06:13.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57612024-11-02T04:06:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57622024-11-02T04:06:13.620ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 76.3769ms iteration = 5 status = {"nsuccess":5}
57632024-11-02T04:06:13.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642024-11-02T04:06:13.621ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57652024-11-02T04:06:13.621ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57662024-11-02T04:06:13.621ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57672024-11-02T04:06:13.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57682024-11-02T04:06:13.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57692024-11-02T04:06:13.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57702024-11-02T04:06:13.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57712024-11-02T04:06:13.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57722024-11-02T04:06:13.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732024-11-02T04:06:13.624ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57742024-11-02T04:06:13.624ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57752024-11-02T04:06:13.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57762024-11-02T04:06:13.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57772024-11-02T04:06:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57782024-11-02T04:06:13.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57792024-11-02T04:06:13.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57802024-11-02T04:06:13.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3035340c-5122-4147-a92e-d028b927dc74 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
57812024-11-02T04:06:13.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3035340c-5122-4147-a92e-d028b927dc74 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
57822024-11-02T04:06:13.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57832024-11-02T04:06:13.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57842024-11-02T04:06:13.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.726675ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57852024-11-02T04:06:13.652ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
57862024-11-02T04:06:13.652ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 110.525054ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57872024-11-02T04:06:13.653ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.953573ms iteration = 22 status = {"physical_disks_added":0}
57882024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57892024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
57902024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
57912024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
57922024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57932024-11-02T04:06:13.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57942024-11-02T04:06:13.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57952024-11-02T04:06:13.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57962024-11-02T04:06:13.664ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57972024-11-02T04:06:13.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.393858ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57982024-11-02T04:06:13.665ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
57992024-11-02T04:06:13.665ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58002024-11-02T04:06:13.665ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.905679ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58012024-11-02T04:06:13.665ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58022024-11-02T04:06:13.665ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58032024-11-02T04:06:13.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.90485ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58042024-11-02T04:06:13.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
58052024-11-02T04:06:13.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58062024-11-02T04:06:13.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58072024-11-02T04:06:13.709ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
58082024-11-02T04:06:13.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58092024-11-02T04:06:13.737ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58102024-11-02T04:06:13.737ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ebdadbb-9170-4b3b-bcb3-d713f0f21de7", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58112024-11-02T04:06:13.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58122024-11-02T04:06:13.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58132024-11-02T04:06:13.743ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
58142024-11-02T04:06:13.743ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58152024-11-02T04:06:13.743ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d48130-f487-4a90-b8f3-9a0805d92e6a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58162024-11-02T04:06:13.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58172024-11-02T04:06:13.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58182024-11-02T04:06:13.776ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
58192024-11-02T04:06:13.914ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 371.693022ms iteration = 19 status = {}
58202024-11-02T04:06:13.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
58212024-11-02T04:06:13.914ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58222024-11-02T04:06:13.915ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58ee92f5-f955-4219-ae12-48259fb992d2", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58232024-11-02T04:06:13.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58242024-11-02T04:06:13.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
58252024-11-02T04:06:13.936ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58262024-11-02T04:06:13.937ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b912880e-7c34-4519-ab80-8d6169e6f40b", "content-length": "1", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58272024-11-02T04:06:13.939ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58282024-11-02T04:06:13.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58292024-11-02T04:06:13.945ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58302024-11-02T04:06:13.945ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58312024-11-02T04:06:13.945ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dc43328-325a-48f5-bb9b-8db29192e03a", "content-length": "372", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58322024-11-02T04:06:13.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58332024-11-02T04:06:13.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58342024-11-02T04:06:13.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 307330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3035340c-5122-4147-a92e-d028b927dc74 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
58352024-11-02T04:06:13.947ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58362024-11-02T04:06:13.947ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58372024-11-02T04:06:13.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58382024-11-02T04:06:13.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58392024-11-02T04:06:13.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58402024-11-02T04:06:13.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 406.907599ms iteration = 19 status = 0
58412024-11-02T04:06:13.949ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 406.906309ms iteration = 19 status = null
58422024-11-02T04:06:13.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432024-11-02T04:06:13.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58442024-11-02T04:06:13.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58452024-11-02T04:06:13.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58462024-11-02T04:06:13.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58472024-11-02T04:06:13.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58482024-11-02T04:06:13.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58492024-11-02T04:06:13.954ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58502024-11-02T04:06:13.954ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
58512024-11-02T04:06:13.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58522024-11-02T04:06:13.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58532024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58542024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58552024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
58562024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58582024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
58592024-11-02T04:06:13.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 413.364658ms iteration = 11 status = {"generation":1}
58602024-11-02T04:06:13.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58612024-11-02T04:06:13.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58622024-11-02T04:06:13.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58632024-11-02T04:06:13.960ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
58642024-11-02T04:06:13.960ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58652024-11-02T04:06:13.960ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
58662024-11-02T04:06:13.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 418.501308ms iteration = 11 status = {"generation":2}
58672024-11-02T04:06:13.967ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58682024-11-02T04:06:13.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6d0f73a2-abed-474c-ad94-07e6f852462d", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58692024-11-02T04:06:13.967ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58702024-11-02T04:06:13.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b7cacb40-005d-43c9-89a3-962dd6bc1256", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58712024-11-02T04:06:13.969ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58722024-11-02T04:06:13.971ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58732024-11-02T04:06:13.971ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 428.770909ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
58742024-11-02T04:06:13.975ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58752024-11-02T04:06:13.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58762024-11-02T04:06:13.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58772024-11-02T04:06:13.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58782024-11-02T04:06:13.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58792024-11-02T04:06:13.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58802024-11-02T04:06:13.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58812024-11-02T04:06:13.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58822024-11-02T04:06:13.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58832024-11-02T04:06:13.992ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
58842024-11-02T04:06:13.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58852024-11-02T04:06:13.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6e0e9cf2-687a-4bb9-b0a3-24724590a2d9", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
58862024-11-02T04:06:13.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58872024-11-02T04:06:13.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58882024-11-02T04:06:13.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58892024-11-02T04:06:13.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58902024-11-02T04:06:13.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58912024-11-02T04:06:13.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58922024-11-02T04:06:14.000ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58932024-11-02T04:06:14.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58942024-11-02T04:06:14.041ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
58952024-11-02T04:06:14.041ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 498.452754ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
58962024-11-02T04:06:14.057ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58972024-11-02T04:06:14.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "adf21543-0d96-489a-b44d-a027c8825837", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
58982024-11-02T04:06:14.057ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
58992024-11-02T04:06:14.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "50c37858-f389-433a-a8cb-9d75a7aa3d5b", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
59002024-11-02T04:06:14.059ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
59012024-11-02T04:06:14.061ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2f00f2b1-d5e1-42e9-9dc7-d1812a92e12a", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
59022024-11-02T04:06:14.061ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
59032024-11-02T04:06:14.063ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
59042024-11-02T04:06:14.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.988958ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59052024-11-02T04:06:14.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59062024-11-02T04:06:14.111ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a4f872c-aa2f-4b5a-987d-13cfe1954b5b", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59072024-11-02T04:06:14.113ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 571.419862ms iteration = 20 status = {}
59082024-11-02T04:06:14.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cf90107-64b6-4052-a773-d632997ed1bd", "content-length": "691", "date": "Sat, 02 Nov 2024 04:06:14 GMT"} })
59092024-11-02T04:06:14.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59102024-11-02T04:06:14.114ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59112024-11-02T04:06:14.114ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59122024-11-02T04:06:14.116ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 573.706471ms iteration = 19 status = {}
59132024-11-02T04:06:14.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59142024-11-02T04:06:14.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59152024-11-02T04:06:14.119ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
59162024-11-02T04:06:14.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59172024-11-02T04:06:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59182024-11-02T04:06:14.126ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59192024-11-02T04:06:14.126ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c160ebe-db33-45a7-b773-6cb40ca7adff", "content-length": "134", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59202024-11-02T04:06:14.126ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59212024-11-02T04:06:14.126ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
59222024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59232024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59242024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59252024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59262024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59272024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59282024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59292024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59302024-11-02T04:06:14.127ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
59312024-11-02T04:06:14.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59322024-11-02T04:06:14.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59332024-11-02T04:06:14.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59342024-11-02T04:06:14.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "edcbc268-395d-420e-a1b0-559020ad688b", "content-length": "2", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59352024-11-02T04:06:14.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59362024-11-02T04:06:14.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e46ee7-bb2e-42fd-a0c2-c98d3d84be03", "content-length": "52", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59372024-11-02T04:06:14.129ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
59382024-11-02T04:06:14.129ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59392024-11-02T04:06:14.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f36bf00e-dd36-4da9-a51d-566e4154e2f1", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59402024-11-02T04:06:14.229ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
59412024-11-02T04:06:14.229ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59422024-11-02T04:06:14.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7466b246-01db-4f99-9217-ab74c5de2bab", "content-length": "682", "date": "Sat, 02 Nov 2024 04:06:13 GMT"} })
59432024-11-02T04:06:14.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59442024-11-02T04:06:14.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59452024-11-02T04:06:14.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59462024-11-02T04:06:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59472024-11-02T04:06:14.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59482024-11-02T04:06:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59492024-11-02T04:06:14.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59502024-11-02T04:06:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59512024-11-02T04:06:14.246ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.434018ms iteration = 19 status = {}
59522024-11-02T04:06:14.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e4e30e-8dd4-459c-8a3e-eb50f99aeb20 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59532024-11-02T04:06:14.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e4e30e-8dd4-459c-8a3e-eb50f99aeb20 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59542024-11-02T04:06:14.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e4e30e-8dd4-459c-8a3e-eb50f99aeb20 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59552024-11-02T04:06:15.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f0f7b9b-b73b-4252-a45d-9069626d11e1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59562024-11-02T04:06:15.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f0f7b9b-b73b-4252-a45d-9069626d11e1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59572024-11-02T04:06:15.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f0f7b9b-b73b-4252-a45d-9069626d11e1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59582024-11-02T04:06:17.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2a8b577f-3739-4723-ad54-df379228735e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59592024-11-02T04:06:17.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2a8b577f-3739-4723-ad54-df379228735e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59602024-11-02T04:06:17.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2a8b577f-3739-4723-ad54-df379228735e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59612024-11-02T04:06:18.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b9837232-ce4c-4168-bbdd-91a626f8accc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59622024-11-02T04:06:18.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b9837232-ce4c-4168-bbdd-91a626f8accc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59632024-11-02T04:06:18.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b9837232-ce4c-4168-bbdd-91a626f8accc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59642024-11-02T04:06:19.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3216df91-a33a-45e4-b628-43525575172c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59652024-11-02T04:06:19.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3216df91-a33a-45e4-b628-43525575172c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59662024-11-02T04:06:19.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3216df91-a33a-45e4-b628-43525575172c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59672024-11-02T04:06:20.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bd1bcc-5d32-4e2b-bf7d-40bb4b0cb070 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59682024-11-02T04:06:20.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bd1bcc-5d32-4e2b-bf7d-40bb4b0cb070 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59692024-11-02T04:06:20.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 28bd1bcc-5d32-4e2b-bf7d-40bb4b0cb070 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59702024-11-02T04:06:21.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb96fbec-bcd6-4660-83f7-d41f6c639b0e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59712024-11-02T04:06:21.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb96fbec-bcd6-4660-83f7-d41f6c639b0e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59722024-11-02T04:06:21.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb96fbec-bcd6-4660-83f7-d41f6c639b0e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59732024-11-02T04:06:22.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee918f5a-8358-4d58-8b77-02b1f64556bc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59742024-11-02T04:06:22.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee918f5a-8358-4d58-8b77-02b1f64556bc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59752024-11-02T04:06:22.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee918f5a-8358-4d58-8b77-02b1f64556bc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59762024-11-02T04:06:23.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ad1d210-4bc0-458b-98ce-af29b0993682 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59772024-11-02T04:06:23.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ad1d210-4bc0-458b-98ce-af29b0993682 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59782024-11-02T04:06:23.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5ad1d210-4bc0-458b-98ce-af29b0993682 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
59792024-11-02T04:06:23.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
59802024-11-02T04:06:23.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59812024-11-02T04:06:23.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
59822024-11-02T04:06:23.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59832024-11-02T04:06:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59842024-11-02T04:06:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59852024-11-02T04:06:23.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59862024-11-02T04:06:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59872024-11-02T04:06:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59882024-11-02T04:06:23.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.631738ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59892024-11-02T04:06:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59902024-11-02T04:06:23.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59912024-11-02T04:06:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59922024-11-02T04:06:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59932024-11-02T04:06:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59942024-11-02T04:06:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59952024-11-02T04:06:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
59962024-11-02T04:06:23.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59972024-11-02T04:06:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59982024-11-02T04:06:23.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
59992024-11-02T04:06:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.804914ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
60002024-11-02T04:06:23.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = e0d1f68d-7ec9-4b0b-9332-ceac5c75735f response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
60012024-11-02T04:06:24.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4233317f-4964-4e7d-9c0a-9ba434c467da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60022024-11-02T04:06:24.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4233317f-4964-4e7d-9c0a-9ba434c467da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60032024-11-02T04:06:24.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4233317f-4964-4e7d-9c0a-9ba434c467da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60042024-11-02T04:06:25.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3af870f4-02f2-4c75-8888-3b428ebfaa3f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60052024-11-02T04:06:25.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3af870f4-02f2-4c75-8888-3b428ebfaa3f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60062024-11-02T04:06:25.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3af870f4-02f2-4c75-8888-3b428ebfaa3f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60072024-11-02T04:06:26.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc699279-2116-4938-b393-e60e5165b5c3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60082024-11-02T04:06:26.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc699279-2116-4938-b393-e60e5165b5c3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60092024-11-02T04:06:26.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cc699279-2116-4938-b393-e60e5165b5c3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60102024-11-02T04:06:27.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 674d12e5-4fce-45f1-a6b0-896dec972c34 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60112024-11-02T04:06:27.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 674d12e5-4fce-45f1-a6b0-896dec972c34 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60122024-11-02T04:06:27.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 674d12e5-4fce-45f1-a6b0-896dec972c34 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60132024-11-02T04:06:28.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8abcd555-deb0-4957-9252-0ba4961cb874 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60142024-11-02T04:06:28.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8abcd555-deb0-4957-9252-0ba4961cb874 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60152024-11-02T04:06:28.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8abcd555-deb0-4957-9252-0ba4961cb874 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60162024-11-02T04:06:29.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0727b761-ee40-42a5-83ed-58003bb1ffcf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60172024-11-02T04:06:29.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0727b761-ee40-42a5-83ed-58003bb1ffcf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60182024-11-02T04:06:29.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0727b761-ee40-42a5-83ed-58003bb1ffcf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60192024-11-02T04:06:30.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 920cf290-9d45-4d82-82cf-d85bc508721e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60202024-11-02T04:06:30.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 920cf290-9d45-4d82-82cf-d85bc508721e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60212024-11-02T04:06:30.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 920cf290-9d45-4d82-82cf-d85bc508721e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60222024-11-02T04:06:31.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78b78a64-a995-449e-a18e-8c990ebcbd6f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60232024-11-02T04:06:31.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78b78a64-a995-449e-a18e-8c990ebcbd6f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60242024-11-02T04:06:31.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 78b78a64-a995-449e-a18e-8c990ebcbd6f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60252024-11-02T04:06:32.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ec00895-4395-42f6-a21d-033e011d5f59 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60262024-11-02T04:06:32.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ec00895-4395-42f6-a21d-033e011d5f59 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60272024-11-02T04:06:32.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2ec00895-4395-42f6-a21d-033e011d5f59 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60282024-11-02T04:06:33.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 254ccc9c-1e2f-40f6-8573-4f8988e4b275 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60292024-11-02T04:06:33.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 254ccc9c-1e2f-40f6-8573-4f8988e4b275 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60302024-11-02T04:06:33.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 254ccc9c-1e2f-40f6-8573-4f8988e4b275 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60312024-11-02T04:06:33.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
60322024-11-02T04:06:33.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
60332024-11-02T04:06:33.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342024-11-02T04:06:33.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60352024-11-02T04:06:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60362024-11-02T04:06:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60372024-11-02T04:06:33.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60382024-11-02T04:06:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60392024-11-02T04:06:33.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-11-02T04:06:33.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.142418ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60412024-11-02T04:06:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60422024-11-02T04:06:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60432024-11-02T04:06:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60442024-11-02T04:06:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60452024-11-02T04:06:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60462024-11-02T04:06:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472024-11-02T04:06:33.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
60482024-11-02T04:06:33.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60492024-11-02T04:06:33.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60502024-11-02T04:06:33.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
60512024-11-02T04:06:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.507019ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
60522024-11-02T04:06:34.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef8f3aac-4555-4e18-9dc8-3e66ac0f3046 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60532024-11-02T04:06:34.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef8f3aac-4555-4e18-9dc8-3e66ac0f3046 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60542024-11-02T04:06:34.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef8f3aac-4555-4e18-9dc8-3e66ac0f3046 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60552024-11-02T04:06:35.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be1a288e-a73c-4062-a399-3bf8a1465599 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60562024-11-02T04:06:35.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be1a288e-a73c-4062-a399-3bf8a1465599 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60572024-11-02T04:06:35.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = be1a288e-a73c-4062-a399-3bf8a1465599 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60582024-11-02T04:06:36.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6651d9ae-3134-4165-86ff-ab4a24ad79f7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60592024-11-02T04:06:36.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6651d9ae-3134-4165-86ff-ab4a24ad79f7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60602024-11-02T04:06:36.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6651d9ae-3134-4165-86ff-ab4a24ad79f7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60612024-11-02T04:06:37.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e116e5a-d881-4f19-badc-1afec3b8b6d8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60622024-11-02T04:06:37.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e116e5a-d881-4f19-badc-1afec3b8b6d8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60632024-11-02T04:06:37.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e116e5a-d881-4f19-badc-1afec3b8b6d8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60642024-11-02T04:06:38.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 398db6e0-a112-4479-89fe-70ae8693bcd8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60652024-11-02T04:06:38.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 398db6e0-a112-4479-89fe-70ae8693bcd8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60662024-11-02T04:06:38.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 398db6e0-a112-4479-89fe-70ae8693bcd8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60672024-11-02T04:06:38.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1666 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 176520c2-0f27-4631-863c-d25222d24964 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
60682024-11-02T04:06:39.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3086d492-3858-4ed6-840d-b2d21c4f437f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60692024-11-02T04:06:39.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3086d492-3858-4ed6-840d-b2d21c4f437f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60702024-11-02T04:06:39.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3086d492-3858-4ed6-840d-b2d21c4f437f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60712024-11-02T04:06:40.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aed9232c-6914-46e0-ae7b-464e2d779092 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60722024-11-02T04:06:40.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aed9232c-6914-46e0-ae7b-464e2d779092 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60732024-11-02T04:06:40.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aed9232c-6914-46e0-ae7b-464e2d779092 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60742024-11-02T04:06:41.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0f6f9de-c741-4393-880e-61b44c59522c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60752024-11-02T04:06:41.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0f6f9de-c741-4393-880e-61b44c59522c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60762024-11-02T04:06:41.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c0f6f9de-c741-4393-880e-61b44c59522c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60772024-11-02T04:06:42.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 961f298c-47d9-42b6-bd71-7265da9d5c70 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60782024-11-02T04:06:42.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 961f298c-47d9-42b6-bd71-7265da9d5c70 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60792024-11-02T04:06:42.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 961f298c-47d9-42b6-bd71-7265da9d5c70 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
60802024-11-02T04:06:43.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = deb5efe5-9e61-457e-87da-f775354ad231 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60812024-11-02T04:06:43.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = deb5efe5-9e61-457e-87da-f775354ad231 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60822024-11-02T04:06:43.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = deb5efe5-9e61-457e-87da-f775354ad231 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60832024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
60842024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
60852024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60862024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60872024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
60882024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60892024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
60902024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60912024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
60922024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
60932024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60942024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
60952024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60962024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60972024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
60982024-11-02T04:06:43.543ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60992024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
61002024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61012024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61022024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61032024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
61042024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
61052024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61062024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61072024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
61082024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
61092024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61102024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
61112024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
61122024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.21\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
61132024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
61142024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.31\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
61152024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.28\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61162024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
61172024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.33\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61182024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61192024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61202024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61212024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61222024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61232024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61242024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61252024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61262024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61272024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61282024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61292024-11-02T04:06:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61302024-11-02T04:06:43.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61312024-11-02T04:06:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61322024-11-02T04:06:43.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61332024-11-02T04:06:43.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.479225ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61342024-11-02T04:06:43.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9907, tv_nsec: 522646348 } })
61352024-11-02T04:06:43.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
61362024-11-02T04:06:43.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9907, tv_nsec: 523032106 } })
61372024-11-02T04:06:43.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
61382024-11-02T04:06:43.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392024-11-02T04:06:43.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402024-11-02T04:06:43.549ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61412024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61422024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61432024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61442024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61452024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61462024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61472024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61482024-11-02T04:06:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61492024-11-02T04:06:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61502024-11-02T04:06:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61512024-11-02T04:06:43.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61522024-11-02T04:06:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61532024-11-02T04:06:43.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61542024-11-02T04:06:43.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61552024-11-02T04:06:43.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61562024-11-02T04:06:43.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.501775ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61572024-11-02T04:06:43.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61582024-11-02T04:06:43.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61592024-11-02T04:06:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61602024-11-02T04:06:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61612024-11-02T04:06:43.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61622024-11-02T04:06:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61632024-11-02T04:06:43.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9907, tv_nsec: 532782155 } })
61642024-11-02T04:06:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61652024-11-02T04:06:43.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61662024-11-02T04:06:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61672024-11-02T04:06:43.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
61682024-11-02T04:06:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61692024-11-02T04:06:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61702024-11-02T04:06:43.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712024-11-02T04:06:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61722024-11-02T04:06:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61732024-11-02T04:06:43.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61742024-11-02T04:06:43.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61752024-11-02T04:06:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762024-11-02T04:06:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61772024-11-02T04:06:43.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61782024-11-02T04:06:43.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61792024-11-02T04:06:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61802024-11-02T04:06:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61812024-11-02T04:06:43.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61822024-11-02T04:06:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61832024-11-02T04:06:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
61842024-11-02T04:06:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61852024-11-02T04:06:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61862024-11-02T04:06:43.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
61872024-11-02T04:06:43.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.768937ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
61882024-11-02T04:06:43.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61892024-11-02T04:06:43.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61902024-11-02T04:06:43.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61912024-11-02T04:06:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61922024-11-02T04:06:43.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61932024-11-02T04:06:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
61942024-11-02T04:06:43.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61952024-11-02T04:06:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61962024-11-02T04:06:43.594ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61972024-11-02T04:06:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61982024-11-02T04:06:43.596ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.210432ms iteration = 20 status = 0
61992024-11-02T04:06:43.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.871977ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62002024-11-02T04:06:43.608ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62012024-11-02T04:06:43.608ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62022024-11-02T04:06:43.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62032024-11-02T04:06:43.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62042024-11-02T04:06:43.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af2daa11-8844-45b9-8042-7ae5c529fbbc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
62052024-11-02T04:06:43.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af2daa11-8844-45b9-8042-7ae5c529fbbc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
62062024-11-02T04:06:43.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62072024-11-02T04:06:43.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.128914ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62082024-11-02T04:06:43.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = af2daa11-8844-45b9-8042-7ae5c529fbbc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
62092024-11-02T04:06:43.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
62102024-11-02T04:06:43.618ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62112024-11-02T04:06:43.618ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bde0f584-638a-4139-85a8-58d544c80bca", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62122024-11-02T04:06:43.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62132024-11-02T04:06:43.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62142024-11-02T04:06:43.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
62152024-11-02T04:06:43.624ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62162024-11-02T04:06:43.624ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b74eee5e-0349-4ba1-ac33-158a8ebc53d8", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62172024-11-02T04:06:43.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62182024-11-02T04:06:43.626ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62192024-11-02T04:06:43.642ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62202024-11-02T04:06:43.642ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62212024-11-02T04:06:43.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.463106ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62222024-11-02T04:06:43.643ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
62232024-11-02T04:06:43.644ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62242024-11-02T04:06:43.644ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac79f932-a37c-414e-abaf-caa4bdd124fc", "content-length": "26", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62252024-11-02T04:06:43.644ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62262024-11-02T04:06:43.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
62272024-11-02T04:06:43.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62282024-11-02T04:06:43.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62292024-11-02T04:06:43.667ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.704808ms iteration = 23 status = {"physical_disks_added":0}
62302024-11-02T04:06:43.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62312024-11-02T04:06:43.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62322024-11-02T04:06:43.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332024-11-02T04:06:43.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62342024-11-02T04:06:43.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62352024-11-02T04:06:43.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62362024-11-02T04:06:43.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62372024-11-02T04:06:43.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62382024-11-02T04:06:43.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62392024-11-02T04:06:43.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62402024-11-02T04:06:43.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.912205ms iteration = 20 status = {}
62412024-11-02T04:06:43.764ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62422024-11-02T04:06:43.764ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62432024-11-02T04:06:43.808ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62442024-11-02T04:06:43.809ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "32989ba0-2f1d-4c06-b995-bbccaafa082e", "content-length": "1", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62452024-11-02T04:06:43.810ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62462024-11-02T04:06:43.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62472024-11-02T04:06:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62482024-11-02T04:06:43.811ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 268.802973ms iteration = 20 status = null
62492024-11-02T04:06:43.865ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a19df55-dea2-4461-af4f-5c2ba779122f", "content-length": "372", "date": "Sat, 02 Nov 2024 04:06:42 GMT"} })
62502024-11-02T04:06:43.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62512024-11-02T04:06:43.865ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b471a8c6-fdc7-43d6-b0d3-58addca1b14e", "content-length": "691", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62522024-11-02T04:06:43.865ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62532024-11-02T04:06:43.865ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62542024-11-02T04:06:43.865ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62552024-11-02T04:06:43.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62562024-11-02T04:06:43.866ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 323.450487ms iteration = 20 status = {}
62572024-11-02T04:06:43.879ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62582024-11-02T04:06:43.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62592024-11-02T04:06:43.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0349030-c690-4fd4-9a37-ccfd20174f63", "date": "Sat, 02 Nov 2024 04:06:42 GMT"} })
62602024-11-02T04:06:43.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62612024-11-02T04:06:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62622024-11-02T04:06:43.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62632024-11-02T04:06:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62642024-11-02T04:06:43.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62652024-11-02T04:06:43.882ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
62662024-11-02T04:06:43.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62672024-11-02T04:06:43.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62682024-11-02T04:06:43.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62692024-11-02T04:06:43.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62702024-11-02T04:06:43.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62712024-11-02T04:06:43.888ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62722024-11-02T04:06:43.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62732024-11-02T04:06:43.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f1028016-36cd-4a26-afc4-9af2a3a18a7f", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62742024-11-02T04:06:43.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.868255ms iteration = 21 status = {}
62752024-11-02T04:06:43.896ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62762024-11-02T04:06:43.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c68df38-abb9-4302-9aac-a8fda5c4d8fc", "content-length": "134", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62772024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62782024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
62792024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62802024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62812024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62822024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62832024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62842024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62852024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62862024-11-02T04:06:43.897ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62872024-11-02T04:06:43.898ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
62882024-11-02T04:06:43.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62892024-11-02T04:06:43.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62902024-11-02T04:06:43.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62912024-11-02T04:06:43.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "16f20515-a4ee-47e2-964c-744ed728c2fb", "content-length": "2", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62922024-11-02T04:06:43.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62932024-11-02T04:06:43.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "526513a7-6f61-4ace-9abe-c518dee2dcf1", "content-length": "52", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62942024-11-02T04:06:43.899ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
62952024-11-02T04:06:43.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62962024-11-02T04:06:44.005ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "51d29c03-87d5-41c6-8c1c-f2b5aa7020dc", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
62972024-11-02T04:06:44.005ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
62982024-11-02T04:06:44.005ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62992024-11-02T04:06:44.006ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "42950c5e-fa5f-4d66-8666-509ff9fce1a0", "content-length": "682", "date": "Sat, 02 Nov 2024 04:06:43 GMT"} })
63002024-11-02T04:06:44.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63012024-11-02T04:06:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63022024-11-02T04:06:44.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63032024-11-02T04:06:44.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63042024-11-02T04:06:44.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63052024-11-02T04:06:44.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63062024-11-02T04:06:44.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63072024-11-02T04:06:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63082024-11-02T04:06:44.024ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.641394ms iteration = 20 status = {}
63092024-11-02T04:06:44.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21ec4582-8e9f-494f-90c0-9a1386bc43e5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63102024-11-02T04:06:44.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21ec4582-8e9f-494f-90c0-9a1386bc43e5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63112024-11-02T04:06:44.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21ec4582-8e9f-494f-90c0-9a1386bc43e5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63122024-11-02T04:06:45.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dca3f46-2f43-4785-a672-0c198281da4a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63132024-11-02T04:06:45.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dca3f46-2f43-4785-a672-0c198281da4a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63142024-11-02T04:06:45.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4dca3f46-2f43-4785-a672-0c198281da4a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63152024-11-02T04:06:46.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6e0e57b-3c22-444e-87eb-4707e2b14751 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63162024-11-02T04:06:46.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6e0e57b-3c22-444e-87eb-4707e2b14751 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63172024-11-02T04:06:46.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6e0e57b-3c22-444e-87eb-4707e2b14751 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63182024-11-02T04:06:47.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b73bb57-4cea-4cf1-bf19-d11a997bb109 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63192024-11-02T04:06:47.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b73bb57-4cea-4cf1-bf19-d11a997bb109 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63202024-11-02T04:06:47.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4b73bb57-4cea-4cf1-bf19-d11a997bb109 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63212024-11-02T04:06:48.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ab7e269c-12bb-4a2b-88ab-72244bb37f24 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63222024-11-02T04:06:48.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ab7e269c-12bb-4a2b-88ab-72244bb37f24 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63232024-11-02T04:06:48.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ab7e269c-12bb-4a2b-88ab-72244bb37f24 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63242024-11-02T04:06:49.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b04e44af-1bf8-43e3-bc5c-779a0dc6c340 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63252024-11-02T04:06:49.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b04e44af-1bf8-43e3-bc5c-779a0dc6c340 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63262024-11-02T04:06:49.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b04e44af-1bf8-43e3-bc5c-779a0dc6c340 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63272024-11-02T04:06:50.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cfed7e7-9d85-491d-ade1-2411cbd985c8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63282024-11-02T04:06:50.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cfed7e7-9d85-491d-ade1-2411cbd985c8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63292024-11-02T04:06:50.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9cfed7e7-9d85-491d-ade1-2411cbd985c8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63302024-11-02T04:06:51.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5bf36bb2-aacd-4833-bf03-83e765f08d5c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63312024-11-02T04:06:51.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5bf36bb2-aacd-4833-bf03-83e765f08d5c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63322024-11-02T04:06:51.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5bf36bb2-aacd-4833-bf03-83e765f08d5c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63332024-11-02T04:06:52.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0a9fdac-cad0-41d2-863b-f82ebacd1069 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63342024-11-02T04:06:52.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0a9fdac-cad0-41d2-863b-f82ebacd1069 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63352024-11-02T04:06:52.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0a9fdac-cad0-41d2-863b-f82ebacd1069 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63362024-11-02T04:06:53.542ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
63372024-11-02T04:06:53.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63382024-11-02T04:06:53.542ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
63392024-11-02T04:06:53.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63402024-11-02T04:06:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63412024-11-02T04:06:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63422024-11-02T04:06:53.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63432024-11-02T04:06:53.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63442024-11-02T04:06:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63452024-11-02T04:06:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63462024-11-02T04:06:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63472024-11-02T04:06:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63482024-11-02T04:06:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63492024-11-02T04:06:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63502024-11-02T04:06:53.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63512024-11-02T04:06:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
63522024-11-02T04:06:53.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63532024-11-02T04:06:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63542024-11-02T04:06:53.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
63552024-11-02T04:06:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.280248ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
63562024-11-02T04:06:53.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.403551ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63572024-11-02T04:06:53.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d629ceb2-defe-42fa-9c76-94920a99a654 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63582024-11-02T04:06:53.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d629ceb2-defe-42fa-9c76-94920a99a654 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63592024-11-02T04:06:53.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d629ceb2-defe-42fa-9c76-94920a99a654 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63602024-11-02T04:06:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1586 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = f6b9265c-7477-4692-9167-7f362548fa2a response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
63612024-11-02T04:06:54.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 12f580ee-9070-4f72-8fc5-bd8b271936c9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63622024-11-02T04:06:54.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 12f580ee-9070-4f72-8fc5-bd8b271936c9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63632024-11-02T04:06:54.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 12f580ee-9070-4f72-8fc5-bd8b271936c9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63642024-11-02T04:06:55.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ede8117e-2b8a-4c78-9173-563b1392102d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63652024-11-02T04:06:55.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ede8117e-2b8a-4c78-9173-563b1392102d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63662024-11-02T04:06:55.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ede8117e-2b8a-4c78-9173-563b1392102d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63672024-11-02T04:06:56.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c928d9-74f7-47bb-8a09-9d7bf1f6ba26 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63682024-11-02T04:06:56.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c928d9-74f7-47bb-8a09-9d7bf1f6ba26 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63692024-11-02T04:06:56.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c928d9-74f7-47bb-8a09-9d7bf1f6ba26 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63702024-11-02T04:06:57.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5c976e-3f1e-4da0-be75-d9c5f0e50533 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63712024-11-02T04:06:57.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5c976e-3f1e-4da0-be75-d9c5f0e50533 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63722024-11-02T04:06:57.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff5c976e-3f1e-4da0-be75-d9c5f0e50533 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63732024-11-02T04:06:58.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37c1d2c3-31f8-4e79-98cb-2adb3c1a59aa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63742024-11-02T04:06:58.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37c1d2c3-31f8-4e79-98cb-2adb3c1a59aa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63752024-11-02T04:06:58.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 37c1d2c3-31f8-4e79-98cb-2adb3c1a59aa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63762024-11-02T04:06:59.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a16ee9d5-e8a8-4569-a320-f58ad8c6b3a8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63772024-11-02T04:06:59.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a16ee9d5-e8a8-4569-a320-f58ad8c6b3a8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63782024-11-02T04:06:59.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a16ee9d5-e8a8-4569-a320-f58ad8c6b3a8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63792024-11-02T04:07:01.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd350654-9270-4bea-9946-4e007aa6f7b6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63802024-11-02T04:07:01.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd350654-9270-4bea-9946-4e007aa6f7b6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63812024-11-02T04:07:01.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd350654-9270-4bea-9946-4e007aa6f7b6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63822024-11-02T04:07:02.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 38d7b983-ffbf-4e9e-9c3e-5ebe667a0a11 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63832024-11-02T04:07:02.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 38d7b983-ffbf-4e9e-9c3e-5ebe667a0a11 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63842024-11-02T04:07:02.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 38d7b983-ffbf-4e9e-9c3e-5ebe667a0a11 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63852024-11-02T04:07:03.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c3140f0-6b63-477b-a0ca-97882d742d2e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63862024-11-02T04:07:03.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c3140f0-6b63-477b-a0ca-97882d742d2e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63872024-11-02T04:07:03.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c3140f0-6b63-477b-a0ca-97882d742d2e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
63882024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
63892024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63902024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
63912024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63922024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63932024-11-02T04:07:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63942024-11-02T04:07:03.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63952024-11-02T04:07:03.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63962024-11-02T04:07:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63972024-11-02T04:07:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63982024-11-02T04:07:03.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63992024-11-02T04:07:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64002024-11-02T04:07:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64012024-11-02T04:07:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64022024-11-02T04:07:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64032024-11-02T04:07:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
64042024-11-02T04:07:03.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64052024-11-02T04:07:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64062024-11-02T04:07:03.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
64072024-11-02T04:07:03.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.179803ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
64082024-11-02T04:07:03.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.308651ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64092024-11-02T04:07:04.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8597f42f-cad4-446a-8dc5-9779a0c839b5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64102024-11-02T04:07:04.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8597f42f-cad4-446a-8dc5-9779a0c839b5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64112024-11-02T04:07:04.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8597f42f-cad4-446a-8dc5-9779a0c839b5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64122024-11-02T04:07:05.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4fb18561-3db1-417b-b988-84ba11ea10f7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64132024-11-02T04:07:05.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4fb18561-3db1-417b-b988-84ba11ea10f7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64142024-11-02T04:07:05.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4fb18561-3db1-417b-b988-84ba11ea10f7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64152024-11-02T04:07:06.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56245974-0ddb-4748-a2b3-01fcf238005b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64162024-11-02T04:07:06.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56245974-0ddb-4748-a2b3-01fcf238005b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64172024-11-02T04:07:06.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56245974-0ddb-4748-a2b3-01fcf238005b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64182024-11-02T04:07:07.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1f5b1c-c61f-4bce-8a24-a1f1acb2c0d7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64192024-11-02T04:07:07.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1f5b1c-c61f-4bce-8a24-a1f1acb2c0d7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64202024-11-02T04:07:07.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2c1f5b1c-c61f-4bce-8a24-a1f1acb2c0d7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64212024-11-02T04:07:08.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfae3df1-4454-496b-a390-6e89854d904b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64222024-11-02T04:07:08.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfae3df1-4454-496b-a390-6e89854d904b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64232024-11-02T04:07:08.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfae3df1-4454-496b-a390-6e89854d904b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64242024-11-02T04:07:08.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1537 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 4614a73d-0687-4d93-82bc-ba47100a825c response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
64252024-11-02T04:07:09.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53379f6e-6207-49b6-a152-028df33e60d8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64262024-11-02T04:07:09.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53379f6e-6207-49b6-a152-028df33e60d8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64272024-11-02T04:07:09.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53379f6e-6207-49b6-a152-028df33e60d8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64282024-11-02T04:07:10.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f9fb380-31ab-4117-bc14-e01089855cd8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64292024-11-02T04:07:10.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f9fb380-31ab-4117-bc14-e01089855cd8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64302024-11-02T04:07:10.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f9fb380-31ab-4117-bc14-e01089855cd8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64312024-11-02T04:07:11.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d226f74-cb43-4c58-adf7-667d62a7891d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64322024-11-02T04:07:11.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d226f74-cb43-4c58-adf7-667d62a7891d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64332024-11-02T04:07:11.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3d226f74-cb43-4c58-adf7-667d62a7891d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64342024-11-02T04:07:12.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f0d090e5-150f-4e3a-97da-b44efa13ca51 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64352024-11-02T04:07:12.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f0d090e5-150f-4e3a-97da-b44efa13ca51 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64362024-11-02T04:07:12.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f0d090e5-150f-4e3a-97da-b44efa13ca51 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64372024-11-02T04:07:13.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb0d6a00-24aa-4904-881b-ddc9fe6db110 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64382024-11-02T04:07:13.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb0d6a00-24aa-4904-881b-ddc9fe6db110 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64392024-11-02T04:07:13.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb0d6a00-24aa-4904-881b-ddc9fe6db110 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
64402024-11-02T04:07:13.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b28c4ecd-f2e8-47ea-b31b-3177ab3f9396 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64412024-11-02T04:07:13.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b28c4ecd-f2e8-47ea-b31b-3177ab3f9396 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64422024-11-02T04:07:13.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b28c4ecd-f2e8-47ea-b31b-3177ab3f9396 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64432024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
64442024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64452024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
64462024-11-02T04:07:13.543ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64472024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
64482024-11-02T04:07:13.543ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64492024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64502024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64512024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
64522024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
64532024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
64542024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
64552024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
64562024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
64572024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64582024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
64592024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
64602024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64612024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
64622024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64632024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64642024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
64652024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64662024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
64672024-11-02T04:07:13.543ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
64682024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
64692024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
64702024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
64712024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.25\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
64722024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64732024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64742024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
64752024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64762024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
64772024-11-02T04:07:13.543ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:57:13.543381800 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64782024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64792024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
64802024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64812024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64822024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
64832024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64842024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
64852024-11-02T04:07:13.543ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
64862024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64872024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
64882024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
64892024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64902024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64912024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
64922024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64932024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
64942024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64952024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64962024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
64972024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64982024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64992024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
65002024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65012024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
65022024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
65032024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65042024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65052024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.221\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65062024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.19\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
65072024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
65082024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
65092024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65102024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.39\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65112024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
65122024-11-02T04:07:13.543ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
65132024-11-02T04:07:13.543ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
65142024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
65152024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.37\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
65162024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65172024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65182024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65192024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65202024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65212024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65222024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65232024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65242024-11-02T04:07:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65252024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65262024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65272024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65282024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65292024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65302024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65312024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65322024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65332024-11-02T04:07:13.544ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 519592952 } })
65342024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65352024-11-02T04:07:13.544ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 519596142 } })
65362024-11-02T04:07:13.544ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
65372024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65382024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
65392024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.376549ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
65402024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
65412024-11-02T04:07:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.554024ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
65422024-11-02T04:07:13.545ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65432024-11-02T04:07:13.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442024-11-02T04:07:13.546ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65452024-11-02T04:07:13.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-11-02T04:07:13.547ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.040876ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65472024-11-02T04:07:13.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 523707601 } })
65482024-11-02T04:07:13.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
65492024-11-02T04:07:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65502024-11-02T04:07:13.548ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65512024-11-02T04:07:13.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65522024-11-02T04:07:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65532024-11-02T04:07:13.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65542024-11-02T04:07:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65552024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65562024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65572024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
65582024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65592024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65602024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65612024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65622024-11-02T04:07:13.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65632024-11-02T04:07:13.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65642024-11-02T04:07:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65652024-11-02T04:07:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65662024-11-02T04:07:13.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672024-11-02T04:07:13.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65682024-11-02T04:07:13.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65692024-11-02T04:07:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65702024-11-02T04:07:13.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65712024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65722024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65732024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65742024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65752024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65762024-11-02T04:07:13.555ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65772024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.951856ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65782024-11-02T04:07:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65792024-11-02T04:07:13.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65802024-11-02T04:07:13.557ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:57:13.543381800 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65812024-11-02T04:07:13.557ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.325377ms iteration = 11 status = {"expiration":"2024-11-02T03:57:13.543381800Z","pruned":[]}
65822024-11-02T04:07:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65832024-11-02T04:07:13.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65842024-11-02T04:07:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65852024-11-02T04:07:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65862024-11-02T04:07:13.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65872024-11-02T04:07:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65882024-11-02T04:07:13.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65892024-11-02T04:07:13.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 539686534 } })
65902024-11-02T04:07:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65912024-11-02T04:07:13.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65922024-11-02T04:07:13.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
65932024-11-02T04:07:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65942024-11-02T04:07:13.569ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.648541ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
65952024-11-02T04:07:13.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65962024-11-02T04:07:13.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 548511143 } })
65972024-11-02T04:07:13.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
65982024-11-02T04:07:13.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65992024-11-02T04:07:13.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66002024-11-02T04:07:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66012024-11-02T04:07:13.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-11-02T04:07:13.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66032024-11-02T04:07:13.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66042024-11-02T04:07:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66052024-11-02T04:07:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66062024-11-02T04:07:13.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66072024-11-02T04:07:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66082024-11-02T04:07:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66092024-11-02T04:07:13.584ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66102024-11-02T04:07:13.584ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66112024-11-02T04:07:13.584ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66122024-11-02T04:07:13.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66132024-11-02T04:07:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66142024-11-02T04:07:13.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66152024-11-02T04:07:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66162024-11-02T04:07:13.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66172024-11-02T04:07:13.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182024-11-02T04:07:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66192024-11-02T04:07:13.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202024-11-02T04:07:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66212024-11-02T04:07:13.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66222024-11-02T04:07:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66232024-11-02T04:07:13.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66242024-11-02T04:07:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66252024-11-02T04:07:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66262024-11-02T04:07:13.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66272024-11-02T04:07:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66282024-11-02T04:07:13.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66292024-11-02T04:07:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66302024-11-02T04:07:13.604ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66312024-11-02T04:07:13.604ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66322024-11-02T04:07:13.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66332024-11-02T04:07:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66342024-11-02T04:07:13.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66352024-11-02T04:07:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66362024-11-02T04:07:13.619ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66372024-11-02T04:07:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.611915ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66382024-11-02T04:07:13.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66392024-11-02T04:07:13.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402024-11-02T04:07:13.623ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66412024-11-02T04:07:13.623ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66422024-11-02T04:07:13.623ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.461028ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66432024-11-02T04:07:13.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66442024-11-02T04:07:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66452024-11-02T04:07:13.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66462024-11-02T04:07:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66472024-11-02T04:07:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66482024-11-02T04:07:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
66492024-11-02T04:07:13.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66502024-11-02T04:07:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66512024-11-02T04:07:13.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66522024-11-02T04:07:13.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66532024-11-02T04:07:13.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66542024-11-02T04:07:13.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66552024-11-02T04:07:13.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66562024-11-02T04:07:13.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66572024-11-02T04:07:13.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66582024-11-02T04:07:13.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66592024-11-02T04:07:13.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66602024-11-02T04:07:13.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66612024-11-02T04:07:13.708ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(47098487-9caa-46ff-9133-5e06ebea4c36, 0), (914ce1c2-e515-4060-886f-0ae148f23be0, 0), (67fb6d8d-0f4e-4132-90f4-752206237ac7, 0), (418b85a6-fd2e-4afc-b04b-d3aa1eced11c, 0)] collection_id = 47098487-9caa-46ff-9133-5e06ebea4c36
66622024-11-02T04:07:13.708ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66632024-11-02T04:07:13.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66642024-11-02T04:07:13.723ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
66652024-11-02T04:07:13.727ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = a2aaea58-b952-4dd3-9a83-7d5ee2937089
66662024-11-02T04:07:13.727ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 16346be1-6991-436d-97fb-11814d51c9db
66672024-11-02T04:07:13.727ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 49172ed5-11fd-406d-9792-c14b87c8a0c8
66682024-11-02T04:07:13.727ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 16346be1-6991-436d-97fb-11814d51c9db
66692024-11-02T04:07:13.727ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 49172ed5-11fd-406d-9792-c14b87c8a0c8
66702024-11-02T04:07:13.727ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = a2aaea58-b952-4dd3-9a83-7d5ee2937089
66712024-11-02T04:07:13.729ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 185.477654ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
66722024-11-02T04:07:13.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
66732024-11-02T04:07:13.746ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66742024-11-02T04:07:13.746ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf3f2a2-1955-4e53-b6e5-1dfd880075c5", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
66752024-11-02T04:07:13.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66762024-11-02T04:07:13.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66772024-11-02T04:07:13.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
66782024-11-02T04:07:13.753ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66792024-11-02T04:07:13.753ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fdfcb9b-4d93-4e8b-bafd-3bc1f402cc7a", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
66802024-11-02T04:07:13.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66812024-11-02T04:07:13.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
66822024-11-02T04:07:13.775ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66832024-11-02T04:07:13.775ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66842024-11-02T04:07:13.776ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "95a83e37-c71c-46e2-a8c1-a5fe81ea6e23", "content-length": "372", "date": "Sat, 02 Nov 2024 04:07:12 GMT"} })
66852024-11-02T04:07:13.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66862024-11-02T04:07:13.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66872024-11-02T04:07:13.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66882024-11-02T04:07:13.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66892024-11-02T04:07:13.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 239.82295ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66902024-11-02T04:07:13.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
66912024-11-02T04:07:13.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 274.538516ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
66922024-11-02T04:07:13.823ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66932024-11-02T04:07:13.824ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
66942024-11-02T04:07:13.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66952024-11-02T04:07:13.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66962024-11-02T04:07:13.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66972024-11-02T04:07:13.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66982024-11-02T04:07:13.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66992024-11-02T04:07:13.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67002024-11-02T04:07:13.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67012024-11-02T04:07:13.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67022024-11-02T04:07:13.831ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
67032024-11-02T04:07:13.831ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67042024-11-02T04:07:13.831ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
67052024-11-02T04:07:13.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 288.2704ms iteration = 12 status = {"generation":2}
67062024-11-02T04:07:13.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67072024-11-02T04:07:13.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67082024-11-02T04:07:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67092024-11-02T04:07:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67102024-11-02T04:07:13.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67112024-11-02T04:07:13.833ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67122024-11-02T04:07:13.833ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67132024-11-02T04:07:13.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67142024-11-02T04:07:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67152024-11-02T04:07:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67162024-11-02T04:07:13.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 291.302426ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67172024-11-02T04:07:13.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-11-02T04:07:13.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67192024-11-02T04:07:13.835ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 47098487-9caa-46ff-9133-5e06ebea4c36 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
67202024-11-02T04:07:13.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67212024-11-02T04:07:13.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67222024-11-02T04:07:13.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232024-11-02T04:07:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67242024-11-02T04:07:13.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67252024-11-02T04:07:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67262024-11-02T04:07:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
67272024-11-02T04:07:13.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67282024-11-02T04:07:13.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67292024-11-02T04:07:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67302024-11-02T04:07:13.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67312024-11-02T04:07:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67322024-11-02T04:07:13.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67332024-11-02T04:07:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67342024-11-02T04:07:13.842ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 299.375449ms iteration = 21 status = 0
67352024-11-02T04:07:13.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67362024-11-02T04:07:13.843ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(914ce1c2-e515-4060-886f-0ae148f23be0, 0), (67fb6d8d-0f4e-4132-90f4-752206237ac7, 0), (418b85a6-fd2e-4afc-b04b-d3aa1eced11c, 0)]
67372024-11-02T04:07:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67382024-11-02T04:07:13.844ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9937, tv_nsec: 819677847 } })
67392024-11-02T04:07:13.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67402024-11-02T04:07:13.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
67412024-11-02T04:07:13.847ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67422024-11-02T04:07:13.847ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf15989-768b-47d3-a12b-829588b2c525", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
67432024-11-02T04:07:13.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67442024-11-02T04:07:13.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67452024-11-02T04:07:13.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67462024-11-02T04:07:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67472024-11-02T04:07:13.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67482024-11-02T04:07:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67492024-11-02T04:07:13.852ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67502024-11-02T04:07:13.852ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67512024-11-02T04:07:13.852ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8ac276da-3fda-40d3-a676-cc54cfab89e8", "date": "Sat, 02 Nov 2024 04:07:12 GMT"} })
67522024-11-02T04:07:13.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67532024-11-02T04:07:13.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67542024-11-02T04:07:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67552024-11-02T04:07:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67562024-11-02T04:07:13.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67572024-11-02T04:07:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67582024-11-02T04:07:13.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67592024-11-02T04:07:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67602024-11-02T04:07:13.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67612024-11-02T04:07:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67622024-11-02T04:07:13.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67632024-11-02T04:07:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67642024-11-02T04:07:13.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67652024-11-02T04:07:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67662024-11-02T04:07:13.861ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67672024-11-02T04:07:13.861ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67682024-11-02T04:07:13.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c606db9-ca75-4b7f-8a99-28f555a81aee", "date": "Sat, 02 Nov 2024 04:07:12 GMT"} })
67692024-11-02T04:07:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.839212ms iteration = 22 status = {}
67702024-11-02T04:07:13.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-11-02T04:07:13.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67722024-11-02T04:07:13.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67732024-11-02T04:07:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67742024-11-02T04:07:13.881ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67752024-11-02T04:07:13.881ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67762024-11-02T04:07:13.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 337.549179ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67772024-11-02T04:07:13.883ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67782024-11-02T04:07:13.883ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67792024-11-02T04:07:13.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67802024-11-02T04:07:13.883ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67812024-11-02T04:07:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67822024-11-02T04:07:13.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67832024-11-02T04:07:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67842024-11-02T04:07:13.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67852024-11-02T04:07:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67862024-11-02T04:07:13.901ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67872024-11-02T04:07:13.901ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67882024-11-02T04:07:13.901ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
67892024-11-02T04:07:13.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.887126ms iteration = 12 status = {"generation":1}
67902024-11-02T04:07:13.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67912024-11-02T04:07:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67922024-11-02T04:07:13.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67932024-11-02T04:07:13.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67942024-11-02T04:07:13.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-11-02T04:07:13.916ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 373.016211ms iteration = 24 status = {"physical_disks_added":0}
67962024-11-02T04:07:13.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67972024-11-02T04:07:13.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67982024-11-02T04:07:13.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67992024-11-02T04:07:13.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68002024-11-02T04:07:13.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68012024-11-02T04:07:13.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022024-11-02T04:07:13.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68032024-11-02T04:07:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68042024-11-02T04:07:13.921ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68052024-11-02T04:07:13.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 377.61223ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68062024-11-02T04:07:13.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68072024-11-02T04:07:13.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68082024-11-02T04:07:13.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68092024-11-02T04:07:13.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68102024-11-02T04:07:13.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68112024-11-02T04:07:13.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68122024-11-02T04:07:13.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68132024-11-02T04:07:13.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68142024-11-02T04:07:13.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68152024-11-02T04:07:13.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68162024-11-02T04:07:13.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68172024-11-02T04:07:13.936ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
68182024-11-02T04:07:13.936ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 393.168724ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68192024-11-02T04:07:13.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68202024-11-02T04:07:13.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68212024-11-02T04:07:13.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68222024-11-02T04:07:13.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68232024-11-02T04:07:13.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68242024-11-02T04:07:13.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68252024-11-02T04:07:13.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262024-11-02T04:07:13.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
68272024-11-02T04:07:13.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68282024-11-02T04:07:13.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68292024-11-02T04:07:13.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68302024-11-02T04:07:13.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68312024-11-02T04:07:14.066ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 522.90385ms iteration = 21 status = {}
68322024-11-02T04:07:14.072ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68332024-11-02T04:07:14.072ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fdf7983-7663-42de-80bb-75eb6a2d3f85", "content-length": "1", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
68342024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
68352024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
68362024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
68372024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e73a1aeb-63ac-4aa4-bd75-623e974a1337", "content-length": "476", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68382024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
68392024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "217f3dc9-4868-47e0-b39a-3aa746291e82", "content-length": "734", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68402024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68412024-11-02T04:07:14.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
68422024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0993d9ce-06bb-4b27-98bf-47be85fead3a", "content-length": "111", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68432024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68442024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
68452024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a357c0f0-9cf6-4aed-ac7a-47baee70613a", "content-length": "111", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68462024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
68472024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1868dfba-1c51-4e95-b078-55da2bcb25d5", "content-length": "167", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68482024-11-02T04:07:14.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
68492024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "496041e7-caaf-4e0a-8e09-f14d5c5d2451", "content-length": "167", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68502024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
68512024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3595da14-d745-4389-9799-bf22eaf9c9cc", "content-length": "175", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68522024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
68532024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d876a41-faf4-4fac-8824-7705d0f65345", "content-length": "175", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68542024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
68552024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1a133e7-fc17-4dac-81e7-c145130e8c99", "content-length": "702", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68562024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
68572024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7797e2e3-bf9d-4b17-98d0-3838eb62543f", "content-length": "727", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68582024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
68592024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d42d61a8-e1f6-4d8b-a6c8-7ff18ed283b3", "content-length": "729", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68602024-11-02T04:07:14.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
68612024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "daea5d42-0a56-4cc7-9ee2-0af2be70d8b6", "content-length": "728", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68622024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
68632024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73ec2a7b-22c9-4960-b4ca-b21decb2973a", "content-length": "722", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68642024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
68652024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "da463587-e73c-4b8e-a643-0b374cd32e77", "content-length": "109", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68662024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
68672024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e67d5c0f-1a0c-4ae3-978f-6265924513e1", "content-length": "109", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68682024-11-02T04:07:14.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
68692024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca415a7-8609-4775-b86b-107ca8e4faf2", "content-length": "169", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68702024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
68712024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "76593a02-199d-490e-be4a-116ba26e740b", "content-length": "169", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68722024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
68732024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "899bb1d5-5310-44a5-a1de-7d200bb9338d", "content-length": "178", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68742024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
68752024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5445d6e-b973-4974-acde-8e901d6cf1dc", "content-length": "178", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68762024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
68772024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c377ea7-faee-41a4-a1ea-8c9474a3f8cd", "content-length": "702", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68782024-11-02T04:07:14.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
68792024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d57dab68-9d4a-497c-9b39-970de3583ce0", "content-length": "727", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68802024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
68812024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2a169dc-3399-4121-933f-2107d6537911", "content-length": "729", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
68822024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
68832024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8590050f-320f-43e4-a334-8d0cf6456ced", "content-length": "728", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
68842024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
68852024-11-02T04:07:14.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
68862024-11-02T04:07:14.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68872024-11-02T04:07:14.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ff7979e1-e4df-4588-bba9-7299a2e1df63", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68882024-11-02T04:07:14.112ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68892024-11-02T04:07:14.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "45f2323d-1369-4d5c-a414-08677dcdcbe1", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68902024-11-02T04:07:14.118ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68912024-11-02T04:07:14.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f191e14b-40c1-484c-b08c-03838f010441", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68922024-11-02T04:07:14.120ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68932024-11-02T04:07:14.122ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68942024-11-02T04:07:14.122ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 579.143487ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68952024-11-02T04:07:14.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68962024-11-02T04:07:14.128ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4b158cc6-36ce-4664-8e6e-3c1e532d3a0d", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68972024-11-02T04:07:14.128ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68982024-11-02T04:07:14.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a8290ade-cc8c-4291-bf95-08bd35022c2e", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68992024-11-02T04:07:14.130ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69002024-11-02T04:07:14.132ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69012024-11-02T04:07:14.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 588.711143ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69022024-11-02T04:07:14.147ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69032024-11-02T04:07:14.147ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a43f635-713c-433f-bcad-44b7a896626a", "content-length": "691", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
69042024-11-02T04:07:14.147ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69052024-11-02T04:07:14.147ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69062024-11-02T04:07:14.147ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69072024-11-02T04:07:14.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69082024-11-02T04:07:14.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69092024-11-02T04:07:14.149ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 606.026175ms iteration = 21 status = {}
69102024-11-02T04:07:14.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69112024-11-02T04:07:14.149ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 606.194699ms iteration = 21 status = null
69122024-11-02T04:07:14.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69132024-11-02T04:07:14.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
69142024-11-02T04:07:14.151ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69152024-11-02T04:07:14.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69162024-11-02T04:07:14.152ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172024-11-02T04:07:14.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
69182024-11-02T04:07:14.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69192024-11-02T04:07:14.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69202024-11-02T04:07:14.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
69212024-11-02T04:07:14.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69222024-11-02T04:07:14.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69232024-11-02T04:07:14.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242024-11-02T04:07:14.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252024-11-02T04:07:14.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69262024-11-02T04:07:14.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69272024-11-02T04:07:14.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69282024-11-02T04:07:14.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69292024-11-02T04:07:14.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69302024-11-02T04:07:14.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69312024-11-02T04:07:14.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69322024-11-02T04:07:14.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69332024-11-02T04:07:14.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69342024-11-02T04:07:14.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69352024-11-02T04:07:14.197ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
69362024-11-02T04:07:14.197ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
69372024-11-02T04:07:14.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69382024-11-02T04:07:14.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69392024-11-02T04:07:14.200ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
69402024-11-02T04:07:14.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69412024-11-02T04:07:14.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69422024-11-02T04:07:14.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69432024-11-02T04:07:14.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69442024-11-02T04:07:14.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69452024-11-02T04:07:14.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69462024-11-02T04:07:14.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69472024-11-02T04:07:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69482024-11-02T04:07:14.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69492024-11-02T04:07:14.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69502024-11-02T04:07:14.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69512024-11-02T04:07:14.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69522024-11-02T04:07:14.209ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69532024-11-02T04:07:14.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "29fff275-7b26-49c9-9070-9f3dd46fc678", "content-length": "134", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
69542024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69552024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
69562024-11-02T04:07:14.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69582024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69592024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69602024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69612024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69622024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69632024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69642024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69652024-11-02T04:07:14.210ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
69662024-11-02T04:07:14.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69672024-11-02T04:07:14.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69682024-11-02T04:07:14.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69692024-11-02T04:07:14.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b31cc5f-8dac-45d1-83d1-9c907dd4686d", "content-length": "2", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
69702024-11-02T04:07:14.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69712024-11-02T04:07:14.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e6d734e-7c2d-4401-9d4b-67b07164548e", "content-length": "52", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
69722024-11-02T04:07:14.213ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
69732024-11-02T04:07:14.213ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69742024-11-02T04:07:14.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69752024-11-02T04:07:14.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69762024-11-02T04:07:14.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69772024-11-02T04:07:14.219ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
69782024-11-02T04:07:14.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69792024-11-02T04:07:14.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69802024-11-02T04:07:14.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812024-11-02T04:07:14.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
69822024-11-02T04:07:14.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69832024-11-02T04:07:14.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69842024-11-02T04:07:14.225ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
69852024-11-02T04:07:14.225ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
69862024-11-02T04:07:14.225ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
69872024-11-02T04:07:14.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e990f25d-e1d2-4064-865f-6b96a6938b4c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
69882024-11-02T04:07:14.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e990f25d-e1d2-4064-865f-6b96a6938b4c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
69892024-11-02T04:07:14.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e990f25d-e1d2-4064-865f-6b96a6938b4c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
69902024-11-02T04:07:14.327ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, time_created: 2024-11-02T03:57:50.261091Z, time_modified: 2024-11-02T03:57:50.261091Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e190f004-2376-4aae-8296-5a5757dc1123, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
69912024-11-02T04:07:14.327ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
69922024-11-02T04:07:14.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69932024-11-02T04:07:14.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69942024-11-02T04:07:14.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69952024-11-02T04:07:14.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69962024-11-02T04:07:14.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69972024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "64dfb28a-9d05-4167-ad68-5f695e73a319", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
69982024-11-02T04:07:14.335ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
69992024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70002024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
70012024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50bc8626-bb5e-420b-932a-f361b7318fb7", "content-length": "682", "date": "Sat, 02 Nov 2024 04:07:13 GMT"} })
70022024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70032024-11-02T04:07:14.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70042024-11-02T04:07:14.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70052024-11-02T04:07:14.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70062024-11-02T04:07:14.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70072024-11-02T04:07:14.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70082024-11-02T04:07:14.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70092024-11-02T04:07:14.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70102024-11-02T04:07:14.356ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 812.951078ms iteration = 21 status = {}
70112024-11-02T04:07:14.367ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
70122024-11-02T04:07:14.368ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1d9cd512-bc4f-4826-9a88-0afc3e1cfcf4", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
70132024-11-02T04:07:14.369ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
70142024-11-02T04:07:14.369ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 826.50429ms
70152024-11-02T04:07:14.369ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 826.51504ms iteration = 3 status = {}
70162024-11-02T04:07:14.459ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "24509caf-f5e0-4ca9-ae6b-b9e12826111f", "content-length": "29198", "date": "Sat, 02 Nov 2024 04:07:14 GMT"} })
70172024-11-02T04:07:14.461ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
70182024-11-02T04:07:14.463ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70192024-11-02T04:07:14.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70202024-11-02T04:07:14.464ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212024-11-02T04:07:14.466ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
70222024-11-02T04:07:14.466ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70232024-11-02T04:07:14.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70242024-11-02T04:07:14.627ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2127c9d9-91cf-46e8-8def-069539cb51de file = nexus/db-queries/src/db/datastore/inventory.rs:1000
70252024-11-02T04:07:14.627ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2127c9d9-91cf-46e8-8def-069539cb51de time_started = 2024-11-02 04:07:14.074128 UTC
70262024-11-02T04:07:14.627ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.084422929s iteration = 4 status = {"collection_id":"2127c9d9-91cf-46e8-8def-069539cb51de","time_done":"2024-11-02 04:07:14.461207 UTC","time_started":"2024-11-02 04:07:14.074128 UTC"}
70272024-11-02T04:07:14.627ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
70282024-11-02T04:07:14.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70292024-11-02T04:07:14.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70302024-11-02T04:07:14.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70312024-11-02T04:07:14.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70322024-11-02T04:07:14.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70332024-11-02T04:07:14.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70342024-11-02T04:07:14.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70352024-11-02T04:07:14.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70362024-11-02T04:07:14.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70372024-11-02T04:07:14.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70382024-11-02T04:07:14.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70392024-11-02T04:07:14.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70402024-11-02T04:07:14.691ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.846481ms iteration = 25 status = {"physical_disks_added":0}
70412024-11-02T04:07:15.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5f83422-8d76-4d3a-a168-4d5b803c791d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70422024-11-02T04:07:15.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5f83422-8d76-4d3a-a168-4d5b803c791d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70432024-11-02T04:07:15.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5f83422-8d76-4d3a-a168-4d5b803c791d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70442024-11-02T04:07:16.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dba207be-3750-4e11-a34e-2de7f5dd3bae roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70452024-11-02T04:07:16.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dba207be-3750-4e11-a34e-2de7f5dd3bae resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70462024-11-02T04:07:16.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dba207be-3750-4e11-a34e-2de7f5dd3bae response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70472024-11-02T04:07:17.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56fafc0b-be51-4a3b-840d-b851b2ff47ba roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70482024-11-02T04:07:17.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56fafc0b-be51-4a3b-840d-b851b2ff47ba resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70492024-11-02T04:07:17.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56fafc0b-be51-4a3b-840d-b851b2ff47ba response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70502024-11-02T04:07:18.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 73a3a7e6-7233-4109-9189-2c8a0b264cd0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70512024-11-02T04:07:18.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 73a3a7e6-7233-4109-9189-2c8a0b264cd0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70522024-11-02T04:07:18.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 73a3a7e6-7233-4109-9189-2c8a0b264cd0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70532024-11-02T04:07:18.962ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54254
70542024-11-02T04:07:18.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54254 req_id = e2774d77-336e-43e3-8085-2ec160a67342 roles = RoleSet { roles: {} } uri = /metrics/producers
70552024-11-02T04:07:18.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54254 req_id = e2774d77-336e-43e3-8085-2ec160a67342 resource = Database result = Ok(()) uri = /metrics/producers
70562024-11-02T04:07:19.001ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 6b8d67f3-a714-4683-8553-09335a4a9d26
70572024-11-02T04:07:19.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38143 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54254 req_id = e2774d77-336e-43e3-8085-2ec160a67342 response_code = 201 uri = /metrics/producers
70582024-11-02T04:07:19.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4318eae6-0a9d-46f5-84c5-29b405ec436d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70592024-11-02T04:07:19.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4318eae6-0a9d-46f5-84c5-29b405ec436d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70602024-11-02T04:07:19.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4318eae6-0a9d-46f5-84c5-29b405ec436d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70612024-11-02T04:07:20.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 458cfa78-b2f1-45a1-9964-e3db8be3f4ab roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70622024-11-02T04:07:20.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 458cfa78-b2f1-45a1-9964-e3db8be3f4ab resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70632024-11-02T04:07:20.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 458cfa78-b2f1-45a1-9964-e3db8be3f4ab response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70642024-11-02T04:07:20.637ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63484
70652024-11-02T04:07:20.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63484 req_id = 00f15c9e-2c66-415c-ad78-612890185e26 roles = RoleSet { roles: {} } uri = /metrics/producers
70662024-11-02T04:07:20.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63484 req_id = 00f15c9e-2c66-415c-ad78-612890185e26 resource = Database result = Ok(()) uri = /metrics/producers
70672024-11-02T04:07:20.672ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = bbe1fec9-a47f-440b-bc9d-2726d77e81dc
70682024-11-02T04:07:20.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34839 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63484 req_id = 00f15c9e-2c66-415c-ad78-612890185e26 response_code = 201 uri = /metrics/producers
70692024-11-02T04:07:21.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 480b8a7a-46f6-4e12-8309-d2b4359c203d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70702024-11-02T04:07:21.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 480b8a7a-46f6-4e12-8309-d2b4359c203d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70712024-11-02T04:07:21.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 480b8a7a-46f6-4e12-8309-d2b4359c203d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70722024-11-02T04:07:21.968ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60561
70732024-11-02T04:07:21.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60561 req_id = f0409994-c93a-4a23-8486-c2c2546a3e7d roles = RoleSet { roles: {} } uri = /metrics/producers
70742024-11-02T04:07:21.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60561 req_id = f0409994-c93a-4a23-8486-c2c2546a3e7d resource = Database result = Ok(()) uri = /metrics/producers
70752024-11-02T04:07:21.977ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d565c44-21ca-41c0-b1d4-bcace41c9902
70762024-11-02T04:07:21.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9241 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60561 req_id = f0409994-c93a-4a23-8486-c2c2546a3e7d response_code = 201 uri = /metrics/producers
70772024-11-02T04:07:22.064ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55737
70782024-11-02T04:07:22.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55737 req_id = 8864c8a1-4102-4351-bec5-6176f6754fe2 roles = RoleSet { roles: {} } uri = /metrics/producers
70792024-11-02T04:07:22.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55737 req_id = 8864c8a1-4102-4351-bec5-6176f6754fe2 resource = Database result = Ok(()) uri = /metrics/producers
70802024-11-02T04:07:22.099ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = df01f79b-0682-4f1b-aa97-1a8bb18b9157
70812024-11-02T04:07:22.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34959 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55737 req_id = 8864c8a1-4102-4351-bec5-6176f6754fe2 response_code = 201 uri = /metrics/producers
70822024-11-02T04:07:22.283ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56665
70832024-11-02T04:07:22.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56665 req_id = 75912fee-ca89-4c63-865d-561dae89955e roles = RoleSet { roles: {} } uri = /metrics/producers
70842024-11-02T04:07:22.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56665 req_id = 75912fee-ca89-4c63-865d-561dae89955e resource = Database result = Ok(()) uri = /metrics/producers
70852024-11-02T04:07:22.317ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 84e94f83-f18a-4122-a272-bfe20f1486da
70862024-11-02T04:07:22.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33762 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56665 req_id = 75912fee-ca89-4c63-865d-561dae89955e response_code = 201 uri = /metrics/producers
70872024-11-02T04:07:22.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b7a1dc0-c14a-4624-a4d8-63924d0ba5ed roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70882024-11-02T04:07:22.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b7a1dc0-c14a-4624-a4d8-63924d0ba5ed resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70892024-11-02T04:07:22.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3b7a1dc0-c14a-4624-a4d8-63924d0ba5ed response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70902024-11-02T04:07:23.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1a98f1b3-b115-482c-b93e-66b971c1d26a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70912024-11-02T04:07:23.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1a98f1b3-b115-482c-b93e-66b971c1d26a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70922024-11-02T04:07:23.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1a98f1b3-b115-482c-b93e-66b971c1d26a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
70932024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
70942024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
70952024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70962024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70972024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70982024-11-02T04:07:23.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70992024-11-02T04:07:23.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71002024-11-02T04:07:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71012024-11-02T04:07:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022024-11-02T04:07:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71032024-11-02T04:07:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71042024-11-02T04:07:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71052024-11-02T04:07:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71062024-11-02T04:07:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
71072024-11-02T04:07:23.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71082024-11-02T04:07:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71092024-11-02T04:07:23.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
71102024-11-02T04:07:23.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.754888ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
71112024-11-02T04:07:23.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71122024-11-02T04:07:23.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71132024-11-02T04:07:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.04085ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71142024-11-02T04:07:23.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1465 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 8bbb3f15-7d04-4d4a-834d-edb9bd46e3ce response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
71152024-11-02T04:07:24.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce5dd04c-4b38-4250-8704-60ecd72a68dd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71162024-11-02T04:07:24.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce5dd04c-4b38-4250-8704-60ecd72a68dd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71172024-11-02T04:07:24.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce5dd04c-4b38-4250-8704-60ecd72a68dd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71182024-11-02T04:07:25.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53177b1b-d796-42d2-b6ce-b86a9e976052 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71192024-11-02T04:07:25.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53177b1b-d796-42d2-b6ce-b86a9e976052 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71202024-11-02T04:07:25.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53177b1b-d796-42d2-b6ce-b86a9e976052 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71212024-11-02T04:07:26.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f9abfba-e1e9-4592-b5fb-d9a8a89c64b7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71222024-11-02T04:07:26.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f9abfba-e1e9-4592-b5fb-d9a8a89c64b7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71232024-11-02T04:07:26.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f9abfba-e1e9-4592-b5fb-d9a8a89c64b7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71242024-11-02T04:07:27.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ab853c8-08f6-4552-92c4-b9c352b55fbd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71252024-11-02T04:07:27.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ab853c8-08f6-4552-92c4-b9c352b55fbd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71262024-11-02T04:07:27.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ab853c8-08f6-4552-92c4-b9c352b55fbd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71272024-11-02T04:07:28.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4714ba01-f239-4d2f-9878-541553771af3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71282024-11-02T04:07:28.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4714ba01-f239-4d2f-9878-541553771af3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71292024-11-02T04:07:28.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4714ba01-f239-4d2f-9878-541553771af3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71302024-11-02T04:07:28.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 777fd47d-52ca-4364-9924-ea59362a870f roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
71312024-11-02T04:07:28.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 777fd47d-52ca-4364-9924-ea59362a870f resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
71322024-11-02T04:07:28.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 777fd47d-52ca-4364-9924-ea59362a870f response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
71332024-11-02T04:07:28.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 73a0b2d6-415b-4456-aac5-d7835d45f635 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
71342024-11-02T04:07:28.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 73a0b2d6-415b-4456-aac5-d7835d45f635 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
71352024-11-02T04:07:28.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 73a0b2d6-415b-4456-aac5-d7835d45f635 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
71362024-11-02T04:07:29.287ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58365
71372024-11-02T04:07:29.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58365 req_id = 621edca1-e445-4799-a452-598b38ba8e1c roles = RoleSet { roles: {} } uri = /metrics/producers
71382024-11-02T04:07:29.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58365 req_id = 621edca1-e445-4799-a452-598b38ba8e1c resource = Database result = Ok(()) uri = /metrics/producers
71392024-11-02T04:07:29.297ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 5b8cdd5a-f021-45f2-8323-b6c8f9776060
71402024-11-02T04:07:29.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9713 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58365 req_id = 621edca1-e445-4799-a452-598b38ba8e1c response_code = 201 uri = /metrics/producers
71412024-11-02T04:07:29.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46c10cf4-3af1-4695-801d-0fe2a9eab447 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71422024-11-02T04:07:29.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46c10cf4-3af1-4695-801d-0fe2a9eab447 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71432024-11-02T04:07:29.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46c10cf4-3af1-4695-801d-0fe2a9eab447 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71442024-11-02T04:07:30.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89329afc-137d-4ddf-af63-26553d414a08 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71452024-11-02T04:07:30.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89329afc-137d-4ddf-af63-26553d414a08 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71462024-11-02T04:07:30.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 89329afc-137d-4ddf-af63-26553d414a08 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71472024-11-02T04:07:31.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b2ad0f2-67ed-4687-ba6b-fd66a1a1999c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71482024-11-02T04:07:31.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b2ad0f2-67ed-4687-ba6b-fd66a1a1999c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71492024-11-02T04:07:31.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b2ad0f2-67ed-4687-ba6b-fd66a1a1999c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71502024-11-02T04:07:32.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91aefb52-a95b-4dd3-97a5-c14e9e7919ab roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71512024-11-02T04:07:32.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91aefb52-a95b-4dd3-97a5-c14e9e7919ab resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71522024-11-02T04:07:32.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 91aefb52-a95b-4dd3-97a5-c14e9e7919ab response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71532024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
71542024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
71552024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71562024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71572024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71582024-11-02T04:07:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71592024-11-02T04:07:33.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602024-11-02T04:07:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71612024-11-02T04:07:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71622024-11-02T04:07:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71632024-11-02T04:07:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71642024-11-02T04:07:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71652024-11-02T04:07:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662024-11-02T04:07:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
71672024-11-02T04:07:33.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71682024-11-02T04:07:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71692024-11-02T04:07:33.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
71702024-11-02T04:07:33.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.358862ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
71712024-11-02T04:07:33.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71722024-11-02T04:07:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71732024-11-02T04:07:33.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.743434ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71742024-11-02T04:07:33.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e737a171-93ee-43e1-baa2-11f17e5bd3de roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71752024-11-02T04:07:33.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e737a171-93ee-43e1-baa2-11f17e5bd3de resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71762024-11-02T04:07:33.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e737a171-93ee-43e1-baa2-11f17e5bd3de response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71772024-11-02T04:07:34.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1ca7946-088f-4bbb-aea9-0b9e8171d5fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71782024-11-02T04:07:34.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1ca7946-088f-4bbb-aea9-0b9e8171d5fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71792024-11-02T04:07:34.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1ca7946-088f-4bbb-aea9-0b9e8171d5fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71802024-11-02T04:07:35.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ba2a6ecb-be86-46b2-b002-df341e287766 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71812024-11-02T04:07:35.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ba2a6ecb-be86-46b2-b002-df341e287766 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71822024-11-02T04:07:35.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ba2a6ecb-be86-46b2-b002-df341e287766 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71832024-11-02T04:07:36.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98cccdbc-afc5-42ae-bfca-561661cd3f41 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71842024-11-02T04:07:36.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98cccdbc-afc5-42ae-bfca-561661cd3f41 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71852024-11-02T04:07:36.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98cccdbc-afc5-42ae-bfca-561661cd3f41 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71862024-11-02T04:07:37.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6426bbef-7e0c-4020-92bf-df2bdff53864 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71872024-11-02T04:07:37.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6426bbef-7e0c-4020-92bf-df2bdff53864 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71882024-11-02T04:07:37.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6426bbef-7e0c-4020-92bf-df2bdff53864 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71892024-11-02T04:07:38.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df2b724-7061-47f3-a223-8d0410e16264 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71902024-11-02T04:07:38.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df2b724-7061-47f3-a223-8d0410e16264 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71912024-11-02T04:07:38.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df2b724-7061-47f3-a223-8d0410e16264 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71922024-11-02T04:07:38.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = c9b30aa4-17cd-4606-bbad-f64e5a605b33 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
71932024-11-02T04:07:39.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85fe3a85-f925-4fa1-b4db-945870f7f83e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71942024-11-02T04:07:39.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85fe3a85-f925-4fa1-b4db-945870f7f83e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71952024-11-02T04:07:39.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 85fe3a85-f925-4fa1-b4db-945870f7f83e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71962024-11-02T04:07:40.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c332842-d372-420f-9c00-7c3b802e94ab roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71972024-11-02T04:07:40.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c332842-d372-420f-9c00-7c3b802e94ab resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71982024-11-02T04:07:40.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c332842-d372-420f-9c00-7c3b802e94ab response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
71992024-11-02T04:07:41.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce635aff-b127-4445-9028-f5c4156ac9da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72002024-11-02T04:07:41.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce635aff-b127-4445-9028-f5c4156ac9da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72012024-11-02T04:07:41.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ce635aff-b127-4445-9028-f5c4156ac9da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72022024-11-02T04:07:42.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0fa752c5-82d3-4e32-a572-209a6f4eba75 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72032024-11-02T04:07:43.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0fa752c5-82d3-4e32-a572-209a6f4eba75 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72042024-11-02T04:07:43.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0fa752c5-82d3-4e32-a572-209a6f4eba75 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
72052024-11-02T04:07:43.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = c5e16f0e-f15b-4d91-8c04-9a9609c939f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
72062024-11-02T04:07:43.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = c5e16f0e-f15b-4d91-8c04-9a9609c939f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
72072024-11-02T04:07:43.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = c5e16f0e-f15b-4d91-8c04-9a9609c939f2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
72082024-11-02T04:07:43.542ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
72092024-11-02T04:07:43.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72102024-11-02T04:07:43.542ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
72112024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
72122024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72132024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
72142024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72152024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72162024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
72172024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
72182024-11-02T04:07:43.543ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72192024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72202024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
72212024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72222024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72232024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72242024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
72252024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
72262024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72272024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72282024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
72292024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72302024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
72312024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
72322024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
72332024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72342024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72352024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72362024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72372024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72382024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72392024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72402024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72412024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72422024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72432024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72442024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72452024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72462024-11-02T04:07:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72472024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
72482024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
72492024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
72502024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.23\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
72512024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.27\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72522024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.98\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
72532024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
72542024-11-02T04:07:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.15\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72552024-11-02T04:07:43.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72562024-11-02T04:07:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72572024-11-02T04:07:43.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72582024-11-02T04:07:43.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9967, tv_nsec: 521695976 } })
72592024-11-02T04:07:43.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.460924ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72602024-11-02T04:07:43.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72612024-11-02T04:07:43.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
72622024-11-02T04:07:43.547ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72632024-11-02T04:07:43.547ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72642024-11-02T04:07:43.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72652024-11-02T04:07:43.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72662024-11-02T04:07:43.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672024-11-02T04:07:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72682024-11-02T04:07:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72692024-11-02T04:07:43.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72702024-11-02T04:07:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72712024-11-02T04:07:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72722024-11-02T04:07:43.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72732024-11-02T04:07:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72742024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72752024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72762024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72772024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72782024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72792024-11-02T04:07:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72802024-11-02T04:07:43.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-11-02T04:07:43.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9967, tv_nsec: 526881148 } })
72822024-11-02T04:07:43.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
72832024-11-02T04:07:43.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842024-11-02T04:07:43.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.908603ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72852024-11-02T04:07:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72862024-11-02T04:07:43.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72872024-11-02T04:07:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72882024-11-02T04:07:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72892024-11-02T04:07:43.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72902024-11-02T04:07:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72912024-11-02T04:07:43.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72922024-11-02T04:07:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72932024-11-02T04:07:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72942024-11-02T04:07:43.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9967, tv_nsec: 533885778 } })
72952024-11-02T04:07:43.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72962024-11-02T04:07:43.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72972024-11-02T04:07:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72982024-11-02T04:07:43.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
72992024-11-02T04:07:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73002024-11-02T04:07:43.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-11-02T04:07:43.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73022024-11-02T04:07:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73032024-11-02T04:07:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73042024-11-02T04:07:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73052024-11-02T04:07:43.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73062024-11-02T04:07:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73072024-11-02T04:07:43.563ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73082024-11-02T04:07:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.110002ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73092024-11-02T04:07:43.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73102024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73112024-11-02T04:07:43.593ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73122024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73132024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73142024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73152024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73162024-11-02T04:07:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73172024-11-02T04:07:43.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73182024-11-02T04:07:43.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73192024-11-02T04:07:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73202024-11-02T04:07:43.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.05635ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73212024-11-02T04:07:43.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73222024-11-02T04:07:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
73232024-11-02T04:07:43.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73242024-11-02T04:07:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73252024-11-02T04:07:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
73262024-11-02T04:07:43.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73272024-11-02T04:07:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73282024-11-02T04:07:43.602ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.855465ms iteration = 22 status = 0
73292024-11-02T04:07:43.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73302024-11-02T04:07:43.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73312024-11-02T04:07:43.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
73322024-11-02T04:07:43.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.713619ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
73332024-11-02T04:07:43.613ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
73342024-11-02T04:07:43.613ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73352024-11-02T04:07:43.614ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e5967dd-1407-4c16-b9cc-4603c279516c", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73362024-11-02T04:07:43.614ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73372024-11-02T04:07:43.616ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73382024-11-02T04:07:43.633ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73392024-11-02T04:07:43.633ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73402024-11-02T04:07:43.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.487514ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73412024-11-02T04:07:43.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
73422024-11-02T04:07:43.644ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73432024-11-02T04:07:43.644ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cccc6567-60a2-4b31-87de-22a7e3ad616b", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73442024-11-02T04:07:43.644ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73452024-11-02T04:07:43.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
73462024-11-02T04:07:43.644ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73472024-11-02T04:07:43.644ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e637c4a-9714-49f6-845e-725f7988e628", "content-length": "26", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73482024-11-02T04:07:43.644ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73492024-11-02T04:07:43.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73502024-11-02T04:07:43.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
73512024-11-02T04:07:43.665ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.718455ms iteration = 26 status = {"physical_disks_added":0}
73522024-11-02T04:07:43.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73532024-11-02T04:07:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73542024-11-02T04:07:43.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552024-11-02T04:07:43.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73562024-11-02T04:07:43.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73572024-11-02T04:07:43.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73582024-11-02T04:07:43.750ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73592024-11-02T04:07:43.750ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73602024-11-02T04:07:43.750ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "280d31b0-5b36-4374-b6f4-a25177542bc8", "content-length": "372", "date": "Sat, 02 Nov 2024 04:07:42 GMT"} })
73612024-11-02T04:07:43.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73622024-11-02T04:07:43.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73632024-11-02T04:07:43.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73642024-11-02T04:07:43.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73652024-11-02T04:07:43.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73662024-11-02T04:07:43.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73672024-11-02T04:07:43.765ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73682024-11-02T04:07:43.765ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73692024-11-02T04:07:43.765ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "511f1f70-525d-4da3-bda6-a42b5c882cec", "date": "Sat, 02 Nov 2024 04:07:42 GMT"} })
73702024-11-02T04:07:43.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73712024-11-02T04:07:43.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73722024-11-02T04:07:43.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73732024-11-02T04:07:43.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73742024-11-02T04:07:43.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73752024-11-02T04:07:43.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73762024-11-02T04:07:43.774ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73772024-11-02T04:07:43.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73782024-11-02T04:07:43.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "847c0e40-8ff1-41b1-9205-d2f0cd073d29", "date": "Sat, 02 Nov 2024 04:07:42 GMT"} })
73792024-11-02T04:07:43.776ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 233.342781ms iteration = 23 status = {}
73802024-11-02T04:07:43.815ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73812024-11-02T04:07:43.815ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "74ea3974-7984-42c6-8d5a-1c8250e712e2", "content-length": "1", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73822024-11-02T04:07:43.817ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73832024-11-02T04:07:43.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73842024-11-02T04:07:43.819ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.851205ms iteration = 22 status = null
73852024-11-02T04:07:43.837ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.233259ms iteration = 22 status = {}
73862024-11-02T04:07:43.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73872024-11-02T04:07:43.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "79367f48-edde-47d0-a47f-9f389d30ee9b", "content-length": "691", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73882024-11-02T04:07:43.883ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73892024-11-02T04:07:43.883ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73902024-11-02T04:07:43.883ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73912024-11-02T04:07:43.885ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 342.794742ms iteration = 22 status = {}
73922024-11-02T04:07:43.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73932024-11-02T04:07:43.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73942024-11-02T04:07:43.902ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
73952024-11-02T04:07:43.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73962024-11-02T04:07:43.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73972024-11-02T04:07:43.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73982024-11-02T04:07:43.909ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a129a48-4510-4aa3-8972-bf778e2bc33d", "content-length": "134", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
73992024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74002024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
74012024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74022024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74032024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74042024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74052024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74062024-11-02T04:07:43.909ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74072024-11-02T04:07:43.910ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74082024-11-02T04:07:43.910ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74092024-11-02T04:07:43.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
74102024-11-02T04:07:43.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74112024-11-02T04:07:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74122024-11-02T04:07:43.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74132024-11-02T04:07:43.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c05886a-1b4d-4227-900c-0e4322dbeee7", "content-length": "2", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
74142024-11-02T04:07:43.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74152024-11-02T04:07:43.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcbd1713-0089-48a6-8ba2-660e2b4a6c61", "content-length": "52", "date": "Sat, 02 Nov 2024 04:07:43 GMT"} })
74162024-11-02T04:07:43.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
74172024-11-02T04:07:43.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74182024-11-02T04:07:44.016ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9636d6b6-d34c-4116-a96b-4e391d029e29", "date": "Sat, 02 Nov 2024 04:07:44 GMT"} })
74192024-11-02T04:07:44.016ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
74202024-11-02T04:07:44.016ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74212024-11-02T04:07:44.016ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "93c98fbb-48ad-4b41-922a-2ab860aa4075", "content-length": "682", "date": "Sat, 02 Nov 2024 04:07:44 GMT"} })
74222024-11-02T04:07:44.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74232024-11-02T04:07:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74242024-11-02T04:07:44.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74252024-11-02T04:07:44.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74262024-11-02T04:07:44.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 04d8699c-2f78-451a-98ae-bac58d6584c0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74272024-11-02T04:07:44.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 04d8699c-2f78-451a-98ae-bac58d6584c0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74282024-11-02T04:07:44.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 04d8699c-2f78-451a-98ae-bac58d6584c0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74292024-11-02T04:07:44.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74302024-11-02T04:07:44.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74312024-11-02T04:07:44.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74322024-11-02T04:07:44.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74332024-11-02T04:07:44.034ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.344442ms iteration = 22 status = {}
74342024-11-02T04:07:45.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e2665b8-5538-4bee-8334-924f2c7dd8e7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74352024-11-02T04:07:45.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e2665b8-5538-4bee-8334-924f2c7dd8e7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74362024-11-02T04:07:45.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6e2665b8-5538-4bee-8334-924f2c7dd8e7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74372024-11-02T04:07:46.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec787672-64af-467f-a00b-5a443cb9817e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74382024-11-02T04:07:46.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec787672-64af-467f-a00b-5a443cb9817e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74392024-11-02T04:07:46.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec787672-64af-467f-a00b-5a443cb9817e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74402024-11-02T04:07:47.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa8da472-a3fa-497b-a556-471c144310f8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74412024-11-02T04:07:47.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa8da472-a3fa-497b-a556-471c144310f8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74422024-11-02T04:07:47.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa8da472-a3fa-497b-a556-471c144310f8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74432024-11-02T04:07:48.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4046b293-164a-4202-904a-525bce5cbdaa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74442024-11-02T04:07:48.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4046b293-164a-4202-904a-525bce5cbdaa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74452024-11-02T04:07:48.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4046b293-164a-4202-904a-525bce5cbdaa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74462024-11-02T04:07:49.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f3b102b-ca65-4c48-83ee-31d3b0649ccf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74472024-11-02T04:07:49.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f3b102b-ca65-4c48-83ee-31d3b0649ccf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74482024-11-02T04:07:49.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8f3b102b-ca65-4c48-83ee-31d3b0649ccf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74492024-11-02T04:07:50.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 282889ba-d145-438d-a61f-daad1fd2fbd4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74502024-11-02T04:07:50.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 282889ba-d145-438d-a61f-daad1fd2fbd4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74512024-11-02T04:07:50.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 282889ba-d145-438d-a61f-daad1fd2fbd4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74522024-11-02T04:07:51.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707fa3fb-de8e-4f55-944b-bbf75d16cc8d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74532024-11-02T04:07:51.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707fa3fb-de8e-4f55-944b-bbf75d16cc8d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74542024-11-02T04:07:51.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707fa3fb-de8e-4f55-944b-bbf75d16cc8d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74552024-11-02T04:07:52.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c140e8a0-9991-4eac-8e1a-160c7db4aee7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74562024-11-02T04:07:52.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c140e8a0-9991-4eac-8e1a-160c7db4aee7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74572024-11-02T04:07:52.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c140e8a0-9991-4eac-8e1a-160c7db4aee7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74582024-11-02T04:07:53.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8346bad5-5cc8-4d32-b392-270445d39dab roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74592024-11-02T04:07:53.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8346bad5-5cc8-4d32-b392-270445d39dab resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74602024-11-02T04:07:53.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8346bad5-5cc8-4d32-b392-270445d39dab response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74612024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
74622024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
74632024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74642024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74652024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74662024-11-02T04:07:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74672024-11-02T04:07:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74682024-11-02T04:07:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74692024-11-02T04:07:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74702024-11-02T04:07:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74712024-11-02T04:07:53.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74722024-11-02T04:07:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74732024-11-02T04:07:53.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74742024-11-02T04:07:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
74752024-11-02T04:07:53.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74762024-11-02T04:07:53.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74772024-11-02T04:07:53.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
74782024-11-02T04:07:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.020987ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
74792024-11-02T04:07:53.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74802024-11-02T04:07:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74812024-11-02T04:07:53.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.322156ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74822024-11-02T04:07:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1325 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = d40170a0-c86b-4095-b18c-e75fd1aa9961 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
74832024-11-02T04:07:54.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555de462-ff00-4660-a8a8-196db7f4c889 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74842024-11-02T04:07:54.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555de462-ff00-4660-a8a8-196db7f4c889 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74852024-11-02T04:07:54.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 555de462-ff00-4660-a8a8-196db7f4c889 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74862024-11-02T04:07:55.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfbbf2bf-82e0-4f7c-8356-5aeef4a432c9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74872024-11-02T04:07:55.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfbbf2bf-82e0-4f7c-8356-5aeef4a432c9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74882024-11-02T04:07:55.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfbbf2bf-82e0-4f7c-8356-5aeef4a432c9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74892024-11-02T04:07:56.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd111c1b-0cc9-455d-a1c9-976844afdd4c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74902024-11-02T04:07:56.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd111c1b-0cc9-455d-a1c9-976844afdd4c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74912024-11-02T04:07:56.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd111c1b-0cc9-455d-a1c9-976844afdd4c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74922024-11-02T04:07:57.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1a5b0d2-13d3-4c39-a089-1ff3ae06c62b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74932024-11-02T04:07:57.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1a5b0d2-13d3-4c39-a089-1ff3ae06c62b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74942024-11-02T04:07:57.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f1a5b0d2-13d3-4c39-a089-1ff3ae06c62b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
74952024-11-02T04:07:57.587ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
74962024-11-02T04:07:57.587ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
74972024-11-02T04:07:57.618ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
74982024-11-02T04:07:57.619ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52643
74992024-11-02T04:07:57.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52643 req_id = e9d9c3c0-0e50-4d4c-b473-75dc71cb5370 roles = RoleSet { roles: {} } uri = /metrics/producers
75002024-11-02T04:07:57.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52643 req_id = e9d9c3c0-0e50-4d4c-b473-75dc71cb5370 resource = Database result = Ok(()) uri = /metrics/producers
75012024-11-02T04:07:57.627ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
75022024-11-02T04:07:57.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8043 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52643 req_id = e9d9c3c0-0e50-4d4c-b473-75dc71cb5370 response_code = 201 uri = /metrics/producers
75032024-11-02T04:07:57.627ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e9d9c3c0-0e50-4d4c-b473-75dc71cb5370", "content-length": "41", "date": "Sat, 02 Nov 2024 04:07:57 GMT"} })
75042024-11-02T04:07:57.628ZDEBGnexus (producer-registration-task): registered with nexus successfully
75052024-11-02T04:07:57.628ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
75062024-11-02T04:07:58.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9d64cae-50de-4ae4-ac49-546ffd96600d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75072024-11-02T04:07:58.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9d64cae-50de-4ae4-ac49-546ffd96600d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75082024-11-02T04:07:58.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d9d64cae-50de-4ae4-ac49-546ffd96600d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75092024-11-02T04:07:58.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = aaaeb5d1-52c3-44a0-bb62-41687eff3205 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
75102024-11-02T04:07:58.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = aaaeb5d1-52c3-44a0-bb62-41687eff3205 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
75112024-11-02T04:07:58.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = aaaeb5d1-52c3-44a0-bb62-41687eff3205 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
75122024-11-02T04:07:58.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = b05bdd61-8907-4e28-b442-c594f9ad8079 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
75132024-11-02T04:07:58.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = b05bdd61-8907-4e28-b442-c594f9ad8079 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
75142024-11-02T04:07:58.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = b05bdd61-8907-4e28-b442-c594f9ad8079 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
75152024-11-02T04:07:59.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 567b3528-239d-4e8f-9dad-87b63b261443 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75162024-11-02T04:07:59.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 567b3528-239d-4e8f-9dad-87b63b261443 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75172024-11-02T04:07:59.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 567b3528-239d-4e8f-9dad-87b63b261443 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75182024-11-02T04:08:00.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 779437be-7c16-4940-a353-3e7be176ef47 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75192024-11-02T04:08:00.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 779437be-7c16-4940-a353-3e7be176ef47 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75202024-11-02T04:08:00.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 779437be-7c16-4940-a353-3e7be176ef47 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75212024-11-02T04:08:01.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d8746bb-9205-4c5a-a469-f2218d16c03e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75222024-11-02T04:08:01.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d8746bb-9205-4c5a-a469-f2218d16c03e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75232024-11-02T04:08:01.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d8746bb-9205-4c5a-a469-f2218d16c03e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75242024-11-02T04:08:02.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7283e436-4dfa-4721-966a-0331a5b73112 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75252024-11-02T04:08:02.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7283e436-4dfa-4721-966a-0331a5b73112 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75262024-11-02T04:08:02.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7283e436-4dfa-4721-966a-0331a5b73112 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75272024-11-02T04:08:03.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ba11be4-747f-4fb4-9865-0c75bf20efb5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75282024-11-02T04:08:03.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ba11be4-747f-4fb4-9865-0c75bf20efb5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75292024-11-02T04:08:03.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ba11be4-747f-4fb4-9865-0c75bf20efb5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75302024-11-02T04:08:03.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
75312024-11-02T04:08:03.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75322024-11-02T04:08:03.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
75332024-11-02T04:08:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75342024-11-02T04:08:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75352024-11-02T04:08:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75362024-11-02T04:08:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372024-11-02T04:08:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75382024-11-02T04:08:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75392024-11-02T04:08:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75402024-11-02T04:08:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75412024-11-02T04:08:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75422024-11-02T04:08:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75432024-11-02T04:08:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
75442024-11-02T04:08:03.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75452024-11-02T04:08:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75462024-11-02T04:08:03.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
75472024-11-02T04:08:03.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.859931ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
75482024-11-02T04:08:03.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75492024-11-02T04:08:03.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75502024-11-02T04:08:03.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.235096ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75512024-11-02T04:08:04.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef1bc04a-5586-4873-9ad2-31e4d0530174 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75522024-11-02T04:08:04.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef1bc04a-5586-4873-9ad2-31e4d0530174 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75532024-11-02T04:08:04.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef1bc04a-5586-4873-9ad2-31e4d0530174 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75542024-11-02T04:08:05.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c6d7f24-7cee-4fa4-a839-c00d44081be2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75552024-11-02T04:08:05.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c6d7f24-7cee-4fa4-a839-c00d44081be2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75562024-11-02T04:08:05.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c6d7f24-7cee-4fa4-a839-c00d44081be2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75572024-11-02T04:08:06.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11fb926a-b75e-49ec-a9a9-f89748ed0a93 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75582024-11-02T04:08:06.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11fb926a-b75e-49ec-a9a9-f89748ed0a93 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75592024-11-02T04:08:06.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11fb926a-b75e-49ec-a9a9-f89748ed0a93 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75602024-11-02T04:08:07.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052b19f6-6889-4c42-85cb-6a9eecca6c55 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75612024-11-02T04:08:07.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052b19f6-6889-4c42-85cb-6a9eecca6c55 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75622024-11-02T04:08:07.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 052b19f6-6889-4c42-85cb-6a9eecca6c55 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75632024-11-02T04:08:08.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfa322cc-8d0d-484d-92f1-20ec3d9979da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75642024-11-02T04:08:08.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfa322cc-8d0d-484d-92f1-20ec3d9979da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75652024-11-02T04:08:08.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bfa322cc-8d0d-484d-92f1-20ec3d9979da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75662024-11-02T04:08:08.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1276 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 0c7e2960-fe60-4c18-bbc8-69b98ca8d1d9 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
75672024-11-02T04:08:09.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5fe0ec7e-87f8-4965-89a9-97b32f84401e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75682024-11-02T04:08:09.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5fe0ec7e-87f8-4965-89a9-97b32f84401e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75692024-11-02T04:08:09.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5fe0ec7e-87f8-4965-89a9-97b32f84401e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75702024-11-02T04:08:10.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19d2c791-3832-46df-96ec-8594d7c2188a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75712024-11-02T04:08:10.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19d2c791-3832-46df-96ec-8594d7c2188a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75722024-11-02T04:08:10.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 19d2c791-3832-46df-96ec-8594d7c2188a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75732024-11-02T04:08:11.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5542dde6-20c7-446f-94b7-67f4e8260170 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75742024-11-02T04:08:11.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5542dde6-20c7-446f-94b7-67f4e8260170 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75752024-11-02T04:08:11.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5542dde6-20c7-446f-94b7-67f4e8260170 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75762024-11-02T04:08:12.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dca4b5a3-feea-4651-925d-140bc0fe4c5f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75772024-11-02T04:08:12.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dca4b5a3-feea-4651-925d-140bc0fe4c5f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75782024-11-02T04:08:12.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dca4b5a3-feea-4651-925d-140bc0fe4c5f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
75792024-11-02T04:08:13.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = f7c47d1b-c2f8-461a-bfa9-e38dc7f8fb9e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
75802024-11-02T04:08:13.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = f7c47d1b-c2f8-461a-bfa9-e38dc7f8fb9e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
75812024-11-02T04:08:13.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = f7c47d1b-c2f8-461a-bfa9-e38dc7f8fb9e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
75822024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
75832024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
75842024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75852024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75862024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
75872024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75882024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
75892024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75902024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
75912024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
75922024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75932024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
75942024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75952024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
75962024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75972024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
75982024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
75992024-11-02T04:08:13.543ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
76002024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.72\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
76012024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76022024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
76032024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76042024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
76052024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76062024-11-02T04:08:13.543ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:58:13.543316528 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76072024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76082024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
76092024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76102024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76112024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
76122024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76132024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
76142024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
76152024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76162024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
76172024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
76182024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76192024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
76202024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76212024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
76222024-11-02T04:08:13.543ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76232024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76242024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
76252024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
76262024-11-02T04:08:13.543ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
76272024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
76282024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76292024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
76302024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76312024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76322024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76332024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76342024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76352024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76362024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76372024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76382024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76392024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76402024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76412024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76422024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76432024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76442024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76452024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76462024-11-02T04:08:13.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76472024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76482024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76492024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
76502024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
76512024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
76522024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76532024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.42\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
76542024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
76552024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
76562024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.27\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76572024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76582024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76592024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
76602024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.21\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76612024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.151\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
76622024-11-02T04:08:13.544ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 9997, tv_nsec: 519165612 } })
76632024-11-02T04:08:13.544ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 9997, tv_nsec: 519185082 } })
76642024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76652024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76662024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
76672024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.254697ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
76682024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
76692024-11-02T04:08:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.358029ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
76702024-11-02T04:08:13.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9997, tv_nsec: 521018902 } })
76712024-11-02T04:08:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.981544ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76722024-11-02T04:08:13.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
76732024-11-02T04:08:13.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-11-02T04:08:13.547ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76752024-11-02T04:08:13.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9997, tv_nsec: 522531834 } })
76762024-11-02T04:08:13.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
76772024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76782024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76792024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76802024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76812024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76822024-11-02T04:08:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76832024-11-02T04:08:13.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76842024-11-02T04:08:13.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76852024-11-02T04:08:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76862024-11-02T04:08:13.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76872024-11-02T04:08:13.553ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:58:13.543316528 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76882024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.76138ms iteration = 12 status = {"expiration":"2024-11-02T03:58:13.543316528Z","pruned":[]}
76892024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76902024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76912024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76922024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76932024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76942024-11-02T04:08:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76952024-11-02T04:08:13.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-11-02T04:08:13.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-11-02T04:08:13.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76982024-11-02T04:08:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76992024-11-02T04:08:13.556ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77002024-11-02T04:08:13.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77012024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77022024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77032024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77042024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77052024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77062024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77072024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77082024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77092024-11-02T04:08:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77102024-11-02T04:08:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77112024-11-02T04:08:13.560ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77122024-11-02T04:08:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77132024-11-02T04:08:13.561ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.640169ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
77142024-11-02T04:08:13.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77152024-11-02T04:08:13.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77162024-11-02T04:08:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77172024-11-02T04:08:13.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77182024-11-02T04:08:13.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77192024-11-02T04:08:13.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77202024-11-02T04:08:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77212024-11-02T04:08:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77222024-11-02T04:08:13.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 9997, tv_nsec: 541905720 } })
77232024-11-02T04:08:13.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
77242024-11-02T04:08:13.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77252024-11-02T04:08:13.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77262024-11-02T04:08:13.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77272024-11-02T04:08:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77282024-11-02T04:08:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77292024-11-02T04:08:13.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77302024-11-02T04:08:13.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77312024-11-02T04:08:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77322024-11-02T04:08:13.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77332024-11-02T04:08:13.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342024-11-02T04:08:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77352024-11-02T04:08:13.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77362024-11-02T04:08:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77372024-11-02T04:08:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
77382024-11-02T04:08:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77392024-11-02T04:08:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77402024-11-02T04:08:13.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77412024-11-02T04:08:13.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77422024-11-02T04:08:13.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
77432024-11-02T04:08:13.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.670031ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
77442024-11-02T04:08:13.598ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77452024-11-02T04:08:13.598ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77462024-11-02T04:08:13.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77472024-11-02T04:08:13.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77482024-11-02T04:08:13.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77492024-11-02T04:08:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77502024-11-02T04:08:13.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77512024-11-02T04:08:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77522024-11-02T04:08:13.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77532024-11-02T04:08:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77542024-11-02T04:08:13.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.226475ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77552024-11-02T04:08:13.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77562024-11-02T04:08:13.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77572024-11-02T04:08:13.606ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77582024-11-02T04:08:13.606ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77592024-11-02T04:08:13.606ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.094303ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77602024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77612024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77622024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77632024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77642024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77652024-11-02T04:08:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77662024-11-02T04:08:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77672024-11-02T04:08:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
77682024-11-02T04:08:13.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77692024-11-02T04:08:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77702024-11-02T04:08:13.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77712024-11-02T04:08:13.612ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.079583ms iteration = 23 status = 0
77722024-11-02T04:08:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77732024-11-02T04:08:13.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77742024-11-02T04:08:13.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77752024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77762024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77772024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77782024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77792024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77802024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77812024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77822024-11-02T04:08:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77832024-11-02T04:08:13.617ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77842024-11-02T04:08:13.617ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77852024-11-02T04:08:13.617ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.597771ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77862024-11-02T04:08:13.619ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77872024-11-02T04:08:13.619ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77882024-11-02T04:08:13.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77892024-11-02T04:08:13.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77902024-11-02T04:08:13.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.473374ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77912024-11-02T04:08:13.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77922024-11-02T04:08:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77932024-11-02T04:08:13.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77942024-11-02T04:08:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77952024-11-02T04:08:13.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77962024-11-02T04:08:13.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77972024-11-02T04:08:13.627ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77982024-11-02T04:08:13.627ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77992024-11-02T04:08:13.627ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
78002024-11-02T04:08:13.627ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 84.24415ms iteration = 13 status = {"generation":1}
78012024-11-02T04:08:13.628ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78022024-11-02T04:08:13.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.789611ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78032024-11-02T04:08:13.662ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78042024-11-02T04:08:13.662ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78052024-11-02T04:08:13.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78062024-11-02T04:08:13.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78072024-11-02T04:08:13.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78082024-11-02T04:08:13.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78092024-11-02T04:08:13.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78102024-11-02T04:08:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78112024-11-02T04:08:13.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78122024-11-02T04:08:13.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78132024-11-02T04:08:13.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78142024-11-02T04:08:13.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78152024-11-02T04:08:13.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
78162024-11-02T04:08:13.698ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78172024-11-02T04:08:13.698ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e16415-8b09-4e3f-a73c-cd728ed8c81d", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78182024-11-02T04:08:13.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78192024-11-02T04:08:13.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78202024-11-02T04:08:13.701ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78212024-11-02T04:08:13.701ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78222024-11-02T04:08:13.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.129966ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78232024-11-02T04:08:13.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78242024-11-02T04:08:13.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78252024-11-02T04:08:13.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78262024-11-02T04:08:13.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78272024-11-02T04:08:13.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f3ef2b2-83ed-48c2-87e6-ccca23b1833b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
78282024-11-02T04:08:13.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f3ef2b2-83ed-48c2-87e6-ccca23b1833b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
78292024-11-02T04:08:13.709ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
78302024-11-02T04:08:13.709ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 165.720229ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78312024-11-02T04:08:13.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78322024-11-02T04:08:13.720ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78332024-11-02T04:08:13.720ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
78342024-11-02T04:08:13.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78352024-11-02T04:08:13.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78362024-11-02T04:08:13.721ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.377851ms iteration = 27 status = {"physical_disks_added":0}
78372024-11-02T04:08:13.747ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
78382024-11-02T04:08:13.748ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78392024-11-02T04:08:13.748ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbb7136-74fe-4e9a-bdf7-c6415f6ed057", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78402024-11-02T04:08:13.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78412024-11-02T04:08:13.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
78422024-11-02T04:08:13.802ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78432024-11-02T04:08:13.835ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78442024-11-02T04:08:13.835ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78452024-11-02T04:08:13.835ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "330f2c98-27fb-437b-8de5-a890dff1bffe", "content-length": "372", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78462024-11-02T04:08:13.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78472024-11-02T04:08:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78482024-11-02T04:08:13.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78492024-11-02T04:08:13.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f3ef2b2-83ed-48c2-87e6-ccca23b1833b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
78502024-11-02T04:08:13.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78512024-11-02T04:08:13.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78522024-11-02T04:08:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78532024-11-02T04:08:13.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78542024-11-02T04:08:13.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78562024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78572024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78582024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78592024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78602024-11-02T04:08:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78612024-11-02T04:08:13.845ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
78622024-11-02T04:08:13.845ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78632024-11-02T04:08:13.845ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
78642024-11-02T04:08:13.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 301.832612ms iteration = 13 status = {"generation":2}
78652024-11-02T04:08:13.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78662024-11-02T04:08:13.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
78672024-11-02T04:08:13.873ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78682024-11-02T04:08:13.873ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b6399f-cf7b-4d08-bce8-6c4990d4fada", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78692024-11-02T04:08:13.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78702024-11-02T04:08:13.874ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
78712024-11-02T04:08:13.874ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 331.345306ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78722024-11-02T04:08:13.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78732024-11-02T04:08:13.881ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78742024-11-02T04:08:13.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78752024-11-02T04:08:13.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 8a9461f9-3890-48eb-9de2-503a52cf2e1c roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
78762024-11-02T04:08:13.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 8a9461f9-3890-48eb-9de2-503a52cf2e1c resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
78772024-11-02T04:08:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 8a9461f9-3890-48eb-9de2-503a52cf2e1c response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
78782024-11-02T04:08:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = df5b9e58-c48d-4baa-80e1-2d74de182b6a roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
78792024-11-02T04:08:13.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = df5b9e58-c48d-4baa-80e1-2d74de182b6a resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
78802024-11-02T04:08:13.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = df5b9e58-c48d-4baa-80e1-2d74de182b6a response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
78812024-11-02T04:08:13.970ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78822024-11-02T04:08:13.971ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45773e5e-817c-47fb-aca5-9afebaa62a2c", "content-length": "1", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78832024-11-02T04:08:13.972ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78842024-11-02T04:08:13.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78852024-11-02T04:08:13.974ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.879124ms iteration = 23 status = null
78862024-11-02T04:08:13.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "06a320c3-98d5-464a-9e3e-06e6f979fa33", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
78872024-11-02T04:08:13.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78882024-11-02T04:08:13.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78892024-11-02T04:08:13.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78902024-11-02T04:08:13.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78912024-11-02T04:08:14.014ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78922024-11-02T04:08:14.014ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "36649963-c1ba-4359-87c1-433689db494e", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78932024-11-02T04:08:14.014ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78942024-11-02T04:08:14.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "63216d18-68ec-46cf-acdd-86f29ba6bda5", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78952024-11-02T04:08:14.016ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78962024-11-02T04:08:14.018ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
78972024-11-02T04:08:14.018ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 474.689565ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78982024-11-02T04:08:14.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78992024-11-02T04:08:14.035ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "740497f4-fab0-484a-bb72-32e5384e9ce3", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79002024-11-02T04:08:14.035ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79012024-11-02T04:08:14.037ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c5951ddc-b00d-4bdb-a542-6de7550aa6f0", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79022024-11-02T04:08:14.037ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79032024-11-02T04:08:14.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2e3d1e79-eb5a-4c8f-aadf-47b85b7c1706", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79042024-11-02T04:08:14.039ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79052024-11-02T04:08:14.040ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
79062024-11-02T04:08:14.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.463354ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79072024-11-02T04:08:14.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79082024-11-02T04:08:14.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a9bf6d-65d1-4142-836d-49fe6a01b8bf", "content-length": "691", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} })
79092024-11-02T04:08:14.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79102024-11-02T04:08:14.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79112024-11-02T04:08:14.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79122024-11-02T04:08:14.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 558.589337ms iteration = 23 status = {}
79132024-11-02T04:08:14.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79142024-11-02T04:08:14.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79152024-11-02T04:08:14.107ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79162024-11-02T04:08:14.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79172024-11-02T04:08:14.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18fe94aa-1281-4b9e-9665-af5a42eb5b87", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} })
79182024-11-02T04:08:14.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 566.67957ms iteration = 24 status = {}
79192024-11-02T04:08:14.111ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 568.685303ms iteration = 23 status = {}
79202024-11-02T04:08:14.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79212024-11-02T04:08:14.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79222024-11-02T04:08:14.143ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
79232024-11-02T04:08:14.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79242024-11-02T04:08:14.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79252024-11-02T04:08:14.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79262024-11-02T04:08:14.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "71e31448-33c0-4713-ade9-bb25c653816a", "content-length": "134", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
79272024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79282024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
79292024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79302024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79312024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79322024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79332024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79342024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79352024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79362024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79372024-11-02T04:08:14.154ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
79382024-11-02T04:08:14.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79392024-11-02T04:08:14.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79402024-11-02T04:08:14.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79412024-11-02T04:08:14.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd718935-d225-4f41-a492-f4927a670206", "content-length": "2", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
79422024-11-02T04:08:14.156ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79432024-11-02T04:08:14.156ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7531938d-5495-4cd6-bb9a-eaf576b71645", "content-length": "52", "date": "Sat, 02 Nov 2024 04:08:13 GMT"} })
79442024-11-02T04:08:14.156ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
79452024-11-02T04:08:14.156ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79462024-11-02T04:08:14.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8c665e14-75b1-447a-beca-124da8ccd93e", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} })
79472024-11-02T04:08:14.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
79482024-11-02T04:08:14.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79492024-11-02T04:08:14.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdebea32-b741-4848-b0b7-3e8a2b9f336c", "content-length": "682", "date": "Sat, 02 Nov 2024 04:08:14 GMT"} })
79502024-11-02T04:08:14.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79512024-11-02T04:08:14.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79522024-11-02T04:08:14.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79532024-11-02T04:08:14.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79542024-11-02T04:08:14.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79552024-11-02T04:08:14.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79562024-11-02T04:08:14.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79572024-11-02T04:08:14.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79582024-11-02T04:08:14.272ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.61863ms iteration = 23 status = {}
79592024-11-02T04:08:14.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dce1faa-f5fc-48a1-95be-f6b348331a25 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79602024-11-02T04:08:14.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dce1faa-f5fc-48a1-95be-f6b348331a25 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79612024-11-02T04:08:14.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dce1faa-f5fc-48a1-95be-f6b348331a25 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79622024-11-02T04:08:15.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0df7abf-061c-4eb7-a41e-77bf55f38ee5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79632024-11-02T04:08:15.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0df7abf-061c-4eb7-a41e-77bf55f38ee5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79642024-11-02T04:08:15.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0df7abf-061c-4eb7-a41e-77bf55f38ee5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79652024-11-02T04:08:16.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e88b4f72-851f-4cd7-bb41-e9d690a101c1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79662024-11-02T04:08:16.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e88b4f72-851f-4cd7-bb41-e9d690a101c1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79672024-11-02T04:08:16.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e88b4f72-851f-4cd7-bb41-e9d690a101c1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79682024-11-02T04:08:17.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db00e4f6-b232-4571-a159-718867fecb4f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79692024-11-02T04:08:17.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db00e4f6-b232-4571-a159-718867fecb4f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79702024-11-02T04:08:17.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = db00e4f6-b232-4571-a159-718867fecb4f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79712024-11-02T04:08:18.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53f10e1d-2ac3-4422-b1f8-cc556e4e30f9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79722024-11-02T04:08:18.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53f10e1d-2ac3-4422-b1f8-cc556e4e30f9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79732024-11-02T04:08:18.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53f10e1d-2ac3-4422-b1f8-cc556e4e30f9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79742024-11-02T04:08:19.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7d06ff20-9e15-46e5-960a-bfa3938ce22a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79752024-11-02T04:08:19.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7d06ff20-9e15-46e5-960a-bfa3938ce22a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79762024-11-02T04:08:19.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7d06ff20-9e15-46e5-960a-bfa3938ce22a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79772024-11-02T04:08:21.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8102f6be-7221-49e2-855a-cc58ee322115 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79782024-11-02T04:08:21.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8102f6be-7221-49e2-855a-cc58ee322115 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79792024-11-02T04:08:21.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8102f6be-7221-49e2-855a-cc58ee322115 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79802024-11-02T04:08:22.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7612b9-853f-4e0e-afa0-e37f57af22a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79812024-11-02T04:08:22.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7612b9-853f-4e0e-afa0-e37f57af22a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79822024-11-02T04:08:22.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4f7612b9-853f-4e0e-afa0-e37f57af22a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79832024-11-02T04:08:23.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00a2cc64-d02b-4b96-ae67-a5545c6ed52e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79842024-11-02T04:08:23.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00a2cc64-d02b-4b96-ae67-a5545c6ed52e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79852024-11-02T04:08:23.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 00a2cc64-d02b-4b96-ae67-a5545c6ed52e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
79862024-11-02T04:08:23.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
79872024-11-02T04:08:23.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
79882024-11-02T04:08:23.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79892024-11-02T04:08:23.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79902024-11-02T04:08:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79912024-11-02T04:08:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79922024-11-02T04:08:23.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79932024-11-02T04:08:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79942024-11-02T04:08:23.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79952024-11-02T04:08:23.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.296211ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79962024-11-02T04:08:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79972024-11-02T04:08:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79982024-11-02T04:08:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79992024-11-02T04:08:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80002024-11-02T04:08:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80012024-11-02T04:08:23.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-11-02T04:08:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
80032024-11-02T04:08:23.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80042024-11-02T04:08:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80052024-11-02T04:08:23.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
80062024-11-02T04:08:23.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.170342ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
80072024-11-02T04:08:23.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1282 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = b042155c-57ce-4e85-84e9-e7521acf975f response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
80082024-11-02T04:08:24.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5a5af1d-661d-42a6-ad4c-bd3c10285299 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80092024-11-02T04:08:24.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5a5af1d-661d-42a6-ad4c-bd3c10285299 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80102024-11-02T04:08:24.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b5a5af1d-661d-42a6-ad4c-bd3c10285299 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80112024-11-02T04:08:25.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0580d2a8-b5d7-438b-aab2-6cc0d82b217e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80122024-11-02T04:08:25.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0580d2a8-b5d7-438b-aab2-6cc0d82b217e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80132024-11-02T04:08:25.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0580d2a8-b5d7-438b-aab2-6cc0d82b217e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80142024-11-02T04:08:26.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69dc45dd-c141-4efc-b45f-0d05b1d794a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80152024-11-02T04:08:26.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69dc45dd-c141-4efc-b45f-0d05b1d794a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80162024-11-02T04:08:26.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69dc45dd-c141-4efc-b45f-0d05b1d794a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80172024-11-02T04:08:27.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 33e113b8-09ff-4974-b1d4-d68ab932aa13 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80182024-11-02T04:08:27.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 33e113b8-09ff-4974-b1d4-d68ab932aa13 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80192024-11-02T04:08:27.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 33e113b8-09ff-4974-b1d4-d68ab932aa13 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80202024-11-02T04:08:28.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5851d46-8808-4ad6-b5a7-25047b8bae0c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80212024-11-02T04:08:28.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5851d46-8808-4ad6-b5a7-25047b8bae0c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80222024-11-02T04:08:28.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5851d46-8808-4ad6-b5a7-25047b8bae0c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80232024-11-02T04:08:29.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 177669f0-fc73-4bbf-b270-5eb94ce94e1d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80242024-11-02T04:08:29.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 177669f0-fc73-4bbf-b270-5eb94ce94e1d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80252024-11-02T04:08:29.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 177669f0-fc73-4bbf-b270-5eb94ce94e1d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80262024-11-02T04:08:30.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0dac30b-66ff-4959-8a34-2316bd8fc44b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80272024-11-02T04:08:30.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0dac30b-66ff-4959-8a34-2316bd8fc44b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80282024-11-02T04:08:30.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b0dac30b-66ff-4959-8a34-2316bd8fc44b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80292024-11-02T04:08:31.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08d75015-4738-4e19-99fc-13eb682ae015 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80302024-11-02T04:08:31.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08d75015-4738-4e19-99fc-13eb682ae015 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80312024-11-02T04:08:31.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08d75015-4738-4e19-99fc-13eb682ae015 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80322024-11-02T04:08:32.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1aa16cb8-4d05-46b5-91b9-4b1cebee6ae9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80332024-11-02T04:08:32.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1aa16cb8-4d05-46b5-91b9-4b1cebee6ae9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80342024-11-02T04:08:32.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1aa16cb8-4d05-46b5-91b9-4b1cebee6ae9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80352024-11-02T04:08:33.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b56c27f8-52f5-43ee-b9c3-97116e27503f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80362024-11-02T04:08:33.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b56c27f8-52f5-43ee-b9c3-97116e27503f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80372024-11-02T04:08:33.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b56c27f8-52f5-43ee-b9c3-97116e27503f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80382024-11-02T04:08:33.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
80392024-11-02T04:08:33.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80402024-11-02T04:08:33.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
80412024-11-02T04:08:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80422024-11-02T04:08:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80432024-11-02T04:08:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80442024-11-02T04:08:33.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80452024-11-02T04:08:33.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80462024-11-02T04:08:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80472024-11-02T04:08:33.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.74273ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80482024-11-02T04:08:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80492024-11-02T04:08:33.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80502024-11-02T04:08:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80512024-11-02T04:08:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80522024-11-02T04:08:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80532024-11-02T04:08:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80542024-11-02T04:08:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
80552024-11-02T04:08:33.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80562024-11-02T04:08:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80572024-11-02T04:08:33.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
80582024-11-02T04:08:33.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.659283ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
80592024-11-02T04:08:34.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98d38ada-1856-47e5-bec1-7f70732a1ef1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80602024-11-02T04:08:34.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98d38ada-1856-47e5-bec1-7f70732a1ef1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80612024-11-02T04:08:34.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 98d38ada-1856-47e5-bec1-7f70732a1ef1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80622024-11-02T04:08:35.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9177685e-b610-4905-b2c9-9317d2e68cd6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80632024-11-02T04:08:35.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9177685e-b610-4905-b2c9-9317d2e68cd6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80642024-11-02T04:08:35.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9177685e-b610-4905-b2c9-9317d2e68cd6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80652024-11-02T04:08:36.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f083f661-8514-4bb8-ae04-725c4b9ae4a4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80662024-11-02T04:08:36.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f083f661-8514-4bb8-ae04-725c4b9ae4a4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80672024-11-02T04:08:36.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f083f661-8514-4bb8-ae04-725c4b9ae4a4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80682024-11-02T04:08:37.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ebcbbc1-9f76-4341-bd8d-aef3c3568927 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80692024-11-02T04:08:37.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ebcbbc1-9f76-4341-bd8d-aef3c3568927 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80702024-11-02T04:08:37.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ebcbbc1-9f76-4341-bd8d-aef3c3568927 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80712024-11-02T04:08:38.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49686bb9-3293-4861-88f7-49350e66fc47 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80722024-11-02T04:08:38.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49686bb9-3293-4861-88f7-49350e66fc47 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80732024-11-02T04:08:38.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 49686bb9-3293-4861-88f7-49350e66fc47 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80742024-11-02T04:08:38.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1386 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 58dd4510-40e3-4f3a-9aca-a0ca8be2c4c1 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
80752024-11-02T04:08:39.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9752d65-fbbf-4985-8772-36fbefb81a30 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80762024-11-02T04:08:39.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9752d65-fbbf-4985-8772-36fbefb81a30 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80772024-11-02T04:08:39.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9752d65-fbbf-4985-8772-36fbefb81a30 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80782024-11-02T04:08:40.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6f23dee-b8e4-445f-9efb-cc23ad45337f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80792024-11-02T04:08:40.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6f23dee-b8e4-445f-9efb-cc23ad45337f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80802024-11-02T04:08:40.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6f23dee-b8e4-445f-9efb-cc23ad45337f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80812024-11-02T04:08:41.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6416ccb9-92a5-48a8-b9f5-b6a3b2a16782 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80822024-11-02T04:08:41.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6416ccb9-92a5-48a8-b9f5-b6a3b2a16782 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80832024-11-02T04:08:41.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6416ccb9-92a5-48a8-b9f5-b6a3b2a16782 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80842024-11-02T04:08:42.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707d268a-7676-4b88-afe2-c715a04aeb3d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80852024-11-02T04:08:42.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707d268a-7676-4b88-afe2-c715a04aeb3d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80862024-11-02T04:08:42.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 707d268a-7676-4b88-afe2-c715a04aeb3d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80872024-11-02T04:08:43.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b0a9db4d-e53a-4557-aa34-70c518273250 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
80882024-11-02T04:08:43.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b0a9db4d-e53a-4557-aa34-70c518273250 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
80892024-11-02T04:08:43.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b0a9db4d-e53a-4557-aa34-70c518273250 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
80902024-11-02T04:08:43.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56798b52-3266-49b4-82a9-dbeed1143d34 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80912024-11-02T04:08:43.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56798b52-3266-49b4-82a9-dbeed1143d34 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80922024-11-02T04:08:43.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 56798b52-3266-49b4-82a9-dbeed1143d34 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
80932024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
80942024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
80952024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80962024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
80972024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80982024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80992024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
81002024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
81012024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81022024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81032024-11-02T04:08:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81042024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
81052024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
81062024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81072024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81082024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
81092024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
81102024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81112024-11-02T04:08:43.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81122024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81132024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
81142024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81152024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
81162024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81172024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
81182024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81192024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
81202024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
81212024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
81222024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.441\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
81232024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.77\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
81242024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
81252024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
81262024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.75\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81272024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.93\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81282024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81302024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81312024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81322024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81332024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81342024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81352024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81362024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81372024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81382024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81392024-11-02T04:08:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81402024-11-02T04:08:43.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81412024-11-02T04:08:43.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10027, tv_nsec: 522015553 } })
81422024-11-02T04:08:43.547ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81432024-11-02T04:08:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81442024-11-02T04:08:43.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
81452024-11-02T04:08:43.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81462024-11-02T04:08:43.548ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.232011ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81472024-11-02T04:08:43.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10027, tv_nsec: 523347042 } })
81482024-11-02T04:08:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81492024-11-02T04:08:43.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81502024-11-02T04:08:43.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
81512024-11-02T04:08:43.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81522024-11-02T04:08:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81532024-11-02T04:08:43.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542024-11-02T04:08:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81552024-11-02T04:08:43.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81562024-11-02T04:08:43.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81572024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81582024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81592024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81602024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81612024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81622024-11-02T04:08:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81632024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81642024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81652024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81662024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81672024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.878585ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81682024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81692024-11-02T04:08:43.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81702024-11-02T04:08:43.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81712024-11-02T04:08:43.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10027, tv_nsec: 531785423 } })
81722024-11-02T04:08:43.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
81732024-11-02T04:08:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81742024-11-02T04:08:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81752024-11-02T04:08:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81762024-11-02T04:08:43.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81772024-11-02T04:08:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81782024-11-02T04:08:43.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.90358ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81792024-11-02T04:08:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81802024-11-02T04:08:43.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81812024-11-02T04:08:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81822024-11-02T04:08:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81832024-11-02T04:08:43.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81842024-11-02T04:08:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81852024-11-02T04:08:43.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81862024-11-02T04:08:43.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81872024-11-02T04:08:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81882024-11-02T04:08:43.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81892024-11-02T04:08:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
81902024-11-02T04:08:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81912024-11-02T04:08:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81922024-11-02T04:08:43.563ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81932024-11-02T04:08:43.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.499389ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81942024-11-02T04:08:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81952024-11-02T04:08:43.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81962024-11-02T04:08:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81972024-11-02T04:08:43.572ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
81982024-11-02T04:08:43.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.074043ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
81992024-11-02T04:08:43.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82002024-11-02T04:08:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82012024-11-02T04:08:43.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82022024-11-02T04:08:43.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82032024-11-02T04:08:43.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042024-11-02T04:08:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
82052024-11-02T04:08:43.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82062024-11-02T04:08:43.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82072024-11-02T04:08:43.591ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82082024-11-02T04:08:43.591ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82092024-11-02T04:08:43.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82102024-11-02T04:08:43.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82112024-11-02T04:08:43.593ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.185696ms iteration = 24 status = 0
82122024-11-02T04:08:43.594ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82132024-11-02T04:08:43.594ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82142024-11-02T04:08:43.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82152024-11-02T04:08:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82162024-11-02T04:08:43.616ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.15497ms iteration = 28 status = {"physical_disks_added":0}
82172024-11-02T04:08:43.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
82182024-11-02T04:08:43.635ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82192024-11-02T04:08:43.635ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1e1dfe6-ec42-4ad7-ae78-6020ff9821a3", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82202024-11-02T04:08:43.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82212024-11-02T04:08:43.637ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82222024-11-02T04:08:43.637ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82232024-11-02T04:08:43.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.112909ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82242024-11-02T04:08:43.637ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82252024-11-02T04:08:43.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
82262024-11-02T04:08:43.655ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82272024-11-02T04:08:43.655ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d2fabc6-8554-486b-ac0b-df40de160a58", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82282024-11-02T04:08:43.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82292024-11-02T04:08:43.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82302024-11-02T04:08:43.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
82312024-11-02T04:08:43.665ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82322024-11-02T04:08:43.665ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd7fceb4-586a-49c4-8605-36da74e741d4", "content-length": "26", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82332024-11-02T04:08:43.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82342024-11-02T04:08:43.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
82352024-11-02T04:08:43.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82362024-11-02T04:08:43.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82372024-11-02T04:08:43.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82382024-11-02T04:08:43.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82392024-11-02T04:08:43.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82402024-11-02T04:08:43.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82412024-11-02T04:08:43.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82422024-11-02T04:08:43.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82432024-11-02T04:08:43.757ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82442024-11-02T04:08:43.757ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "54661ad8-caac-48f3-a4e5-a84d8449869a", "content-length": "1", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82452024-11-02T04:08:43.759ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82462024-11-02T04:08:43.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82472024-11-02T04:08:43.841ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82482024-11-02T04:08:43.841ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82492024-11-02T04:08:43.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502024-11-02T04:08:43.843ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.8423ms iteration = 24 status = null
82512024-11-02T04:08:43.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82522024-11-02T04:08:43.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82532024-11-02T04:08:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82542024-11-02T04:08:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.032945ms iteration = 24 status = {}
82552024-11-02T04:08:43.858ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d90324b-13ca-4115-b198-0389ab85718b", "content-length": "372", "date": "Sat, 02 Nov 2024 04:08:42 GMT"} })
82562024-11-02T04:08:43.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82572024-11-02T04:08:43.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82582024-11-02T04:08:43.873ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
82592024-11-02T04:08:43.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82602024-11-02T04:08:43.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "20435fc1-36c1-421b-b9f2-9db4524b77f7", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82612024-11-02T04:08:43.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82622024-11-02T04:08:43.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82632024-11-02T04:08:43.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82642024-11-02T04:08:43.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82652024-11-02T04:08:43.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82662024-11-02T04:08:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82672024-11-02T04:08:43.881ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82682024-11-02T04:08:43.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82692024-11-02T04:08:43.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d318c715-a797-44ef-809c-4cc35e94b093", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82702024-11-02T04:08:43.883ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 339.41699ms iteration = 25 status = {}
82712024-11-02T04:08:43.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82722024-11-02T04:08:43.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "460ba2b7-0aa3-4314-8783-649e25c4d419", "content-length": "691", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82732024-11-02T04:08:43.906ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82742024-11-02T04:08:43.906ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82752024-11-02T04:08:43.906ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82762024-11-02T04:08:43.908ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.246473ms iteration = 24 status = {}
82772024-11-02T04:08:43.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = fb76a007-3bf3-45c2-b37f-16864f4a4cbb roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
82782024-11-02T04:08:43.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = fb76a007-3bf3-45c2-b37f-16864f4a4cbb resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
82792024-11-02T04:08:43.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = fb76a007-3bf3-45c2-b37f-16864f4a4cbb response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
82802024-11-02T04:08:43.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3251fb0a-7f9b-42e9-a3d6-01389b1da564 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
82812024-11-02T04:08:43.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3251fb0a-7f9b-42e9-a3d6-01389b1da564 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
82822024-11-02T04:08:43.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 3251fb0a-7f9b-42e9-a3d6-01389b1da564 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
82832024-11-02T04:08:43.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82842024-11-02T04:08:43.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82852024-11-02T04:08:43.920ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
82862024-11-02T04:08:43.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82872024-11-02T04:08:43.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82882024-11-02T04:08:43.930ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82892024-11-02T04:08:43.930ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "650128c9-fbea-4498-aa2e-0218df98deb4", "content-length": "134", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
82902024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82912024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
82922024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82932024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82942024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82952024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82962024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82972024-11-02T04:08:43.930ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82982024-11-02T04:08:43.931ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82992024-11-02T04:08:43.931ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83002024-11-02T04:08:43.931ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
83012024-11-02T04:08:43.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83022024-11-02T04:08:43.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83032024-11-02T04:08:43.933ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83042024-11-02T04:08:43.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8361995-4387-4e7d-b242-371be7757cf7", "content-length": "2", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
83052024-11-02T04:08:43.933ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83062024-11-02T04:08:43.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac378085-21ee-4456-bea7-c2a37c58ee06", "content-length": "52", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
83072024-11-02T04:08:43.933ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
83082024-11-02T04:08:43.933ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83092024-11-02T04:08:44.043ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c185985d-71a0-457e-8bc4-f215a0aa3666", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
83102024-11-02T04:08:44.043ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
83112024-11-02T04:08:44.043ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83122024-11-02T04:08:44.045ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e75fa71d-98de-4f6d-a3ce-72cc833ec98a", "content-length": "682", "date": "Sat, 02 Nov 2024 04:08:43 GMT"} })
83132024-11-02T04:08:44.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83142024-11-02T04:08:44.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83152024-11-02T04:08:44.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83162024-11-02T04:08:44.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83172024-11-02T04:08:44.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83182024-11-02T04:08:44.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83192024-11-02T04:08:44.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83202024-11-02T04:08:44.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83212024-11-02T04:08:44.067ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 523.460851ms iteration = 24 status = {}
83222024-11-02T04:08:44.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39d81345-c132-47a0-bfa8-60b47ffb79b1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83232024-11-02T04:08:44.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39d81345-c132-47a0-bfa8-60b47ffb79b1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83242024-11-02T04:08:44.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 39d81345-c132-47a0-bfa8-60b47ffb79b1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83252024-11-02T04:08:45.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06d39c08-5c16-4aae-83e9-2db34cea628d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83262024-11-02T04:08:45.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06d39c08-5c16-4aae-83e9-2db34cea628d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83272024-11-02T04:08:45.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06d39c08-5c16-4aae-83e9-2db34cea628d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83282024-11-02T04:08:46.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc69329c-0295-4fbb-858b-62fbacbffc19 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83292024-11-02T04:08:46.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc69329c-0295-4fbb-858b-62fbacbffc19 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83302024-11-02T04:08:46.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bc69329c-0295-4fbb-858b-62fbacbffc19 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83312024-11-02T04:08:47.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16bb77ca-8a12-4723-940d-a31f2f44d5d4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83322024-11-02T04:08:47.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16bb77ca-8a12-4723-940d-a31f2f44d5d4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83332024-11-02T04:08:47.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 16bb77ca-8a12-4723-940d-a31f2f44d5d4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83342024-11-02T04:08:48.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1f25cf9-8925-4efe-abcd-1389159ac8c9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83352024-11-02T04:08:48.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1f25cf9-8925-4efe-abcd-1389159ac8c9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83362024-11-02T04:08:48.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1f25cf9-8925-4efe-abcd-1389159ac8c9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83372024-11-02T04:08:49.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b79d7390-4050-4db8-ba9e-f624ed9ef6a2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83382024-11-02T04:08:49.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b79d7390-4050-4db8-ba9e-f624ed9ef6a2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83392024-11-02T04:08:49.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b79d7390-4050-4db8-ba9e-f624ed9ef6a2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83402024-11-02T04:08:50.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6dd2500d-4709-4842-a0e6-7367e1fd7d93 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83412024-11-02T04:08:50.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6dd2500d-4709-4842-a0e6-7367e1fd7d93 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83422024-11-02T04:08:50.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6dd2500d-4709-4842-a0e6-7367e1fd7d93 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83432024-11-02T04:08:51.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7fbfe75a-90d3-4074-b405-7c98e5c098da roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83442024-11-02T04:08:51.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7fbfe75a-90d3-4074-b405-7c98e5c098da resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83452024-11-02T04:08:51.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7fbfe75a-90d3-4074-b405-7c98e5c098da response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83462024-11-02T04:08:52.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 48f8b1d7-b72c-4268-90d4-f3cc1821a1f5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83472024-11-02T04:08:52.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 48f8b1d7-b72c-4268-90d4-f3cc1821a1f5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83482024-11-02T04:08:52.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 48f8b1d7-b72c-4268-90d4-f3cc1821a1f5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83492024-11-02T04:08:53.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
83502024-11-02T04:08:53.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83512024-11-02T04:08:53.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
83522024-11-02T04:08:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83532024-11-02T04:08:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83542024-11-02T04:08:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83552024-11-02T04:08:53.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83562024-11-02T04:08:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83572024-11-02T04:08:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83582024-11-02T04:08:53.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.117699ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83592024-11-02T04:08:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83602024-11-02T04:08:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83612024-11-02T04:08:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83622024-11-02T04:08:53.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83632024-11-02T04:08:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83642024-11-02T04:08:53.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83652024-11-02T04:08:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
83662024-11-02T04:08:53.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83672024-11-02T04:08:53.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83682024-11-02T04:08:53.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
83692024-11-02T04:08:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.647062ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
83702024-11-02T04:08:53.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec52faf0-c4d2-40ff-ae7a-bcfb5e8c6a15 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83712024-11-02T04:08:53.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec52faf0-c4d2-40ff-ae7a-bcfb5e8c6a15 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83722024-11-02T04:08:53.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ec52faf0-c4d2-40ff-ae7a-bcfb5e8c6a15 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83732024-11-02T04:08:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1333 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 4efe2977-9f31-4b24-a5d0-6ad36a2a9076 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
83742024-11-02T04:08:54.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8793730-3cd0-45c2-b3eb-c31f2b36bb99 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83752024-11-02T04:08:54.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8793730-3cd0-45c2-b3eb-c31f2b36bb99 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83762024-11-02T04:08:54.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d8793730-3cd0-45c2-b3eb-c31f2b36bb99 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83772024-11-02T04:08:55.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8c8bb-b025-48c9-ad32-41400c1f8fa3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83782024-11-02T04:08:55.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8c8bb-b025-48c9-ad32-41400c1f8fa3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83792024-11-02T04:08:55.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ef8c8bb-b025-48c9-ad32-41400c1f8fa3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83802024-11-02T04:08:56.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5ce2780-e5c5-4c9a-a497-e532485fb540 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83812024-11-02T04:08:56.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5ce2780-e5c5-4c9a-a497-e532485fb540 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83822024-11-02T04:08:56.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a5ce2780-e5c5-4c9a-a497-e532485fb540 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83832024-11-02T04:08:57.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ec27ba3-2c4c-4f68-814d-aac93c2c0eda roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83842024-11-02T04:08:57.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ec27ba3-2c4c-4f68-814d-aac93c2c0eda resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83852024-11-02T04:08:57.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ec27ba3-2c4c-4f68-814d-aac93c2c0eda response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83862024-11-02T04:08:58.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8bb2d998-b2c7-49aa-9581-8c2a1b8687fd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83872024-11-02T04:08:58.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8bb2d998-b2c7-49aa-9581-8c2a1b8687fd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83882024-11-02T04:08:58.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8bb2d998-b2c7-49aa-9581-8c2a1b8687fd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83892024-11-02T04:08:59.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d62724e-7eca-41b8-a2aa-e4b41dc554fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83902024-11-02T04:08:59.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d62724e-7eca-41b8-a2aa-e4b41dc554fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83912024-11-02T04:08:59.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d62724e-7eca-41b8-a2aa-e4b41dc554fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83922024-11-02T04:09:00.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e9b3be-a98a-4453-b7aa-61f1fe25205e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83932024-11-02T04:09:00.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e9b3be-a98a-4453-b7aa-61f1fe25205e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83942024-11-02T04:09:00.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03e9b3be-a98a-4453-b7aa-61f1fe25205e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83952024-11-02T04:09:01.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3f8f00bb-1377-43a9-91c9-4b2306632b78 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83962024-11-02T04:09:01.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3f8f00bb-1377-43a9-91c9-4b2306632b78 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83972024-11-02T04:09:01.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3f8f00bb-1377-43a9-91c9-4b2306632b78 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83982024-11-02T04:09:02.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0119ecca-2396-4881-a97d-aa835c2c96f8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
83992024-11-02T04:09:02.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0119ecca-2396-4881-a97d-aa835c2c96f8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84002024-11-02T04:09:02.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0119ecca-2396-4881-a97d-aa835c2c96f8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84012024-11-02T04:09:03.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
84022024-11-02T04:09:03.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84032024-11-02T04:09:03.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
84042024-11-02T04:09:03.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84052024-11-02T04:09:03.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84062024-11-02T04:09:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84072024-11-02T04:09:03.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84082024-11-02T04:09:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84092024-11-02T04:09:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84102024-11-02T04:09:03.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.946323ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84112024-11-02T04:09:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84122024-11-02T04:09:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84132024-11-02T04:09:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84142024-11-02T04:09:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84152024-11-02T04:09:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84162024-11-02T04:09:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84172024-11-02T04:09:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
84182024-11-02T04:09:03.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84192024-11-02T04:09:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84202024-11-02T04:09:03.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
84212024-11-02T04:09:03.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.703092ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
84222024-11-02T04:09:04.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6889fe2-3f2b-4099-9a92-6281266c28c7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84232024-11-02T04:09:04.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6889fe2-3f2b-4099-9a92-6281266c28c7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84242024-11-02T04:09:04.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f6889fe2-3f2b-4099-9a92-6281266c28c7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84252024-11-02T04:09:05.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df910eb-59f6-4a91-8d97-e4460fadb111 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84262024-11-02T04:09:05.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df910eb-59f6-4a91-8d97-e4460fadb111 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84272024-11-02T04:09:05.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3df910eb-59f6-4a91-8d97-e4460fadb111 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84282024-11-02T04:09:06.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59897835-f403-41d8-bc6d-6c09d986d872 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84292024-11-02T04:09:06.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59897835-f403-41d8-bc6d-6c09d986d872 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84302024-11-02T04:09:06.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59897835-f403-41d8-bc6d-6c09d986d872 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84312024-11-02T04:09:07.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 71b17e90-b365-4d56-b01b-4984b2bb8fa7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84322024-11-02T04:09:07.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 71b17e90-b365-4d56-b01b-4984b2bb8fa7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84332024-11-02T04:09:07.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 71b17e90-b365-4d56-b01b-4984b2bb8fa7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84342024-11-02T04:09:08.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1297c29e-a1dc-44fd-aaba-25afb0958704 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84352024-11-02T04:09:08.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1297c29e-a1dc-44fd-aaba-25afb0958704 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84362024-11-02T04:09:08.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1297c29e-a1dc-44fd-aaba-25afb0958704 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84372024-11-02T04:09:08.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1454 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 195a8c9e-3f65-4e15-a2a0-1f5bec2dcbc9 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
84382024-11-02T04:09:09.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e36cd97-5188-4a6b-b697-f7766b6632fe roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84392024-11-02T04:09:09.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e36cd97-5188-4a6b-b697-f7766b6632fe resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84402024-11-02T04:09:09.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8e36cd97-5188-4a6b-b697-f7766b6632fe response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84412024-11-02T04:09:10.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4e321367-7a3c-4890-89d8-71b490308ab6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84422024-11-02T04:09:10.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4e321367-7a3c-4890-89d8-71b490308ab6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84432024-11-02T04:09:10.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4e321367-7a3c-4890-89d8-71b490308ab6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84442024-11-02T04:09:11.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bd16d3bf-e960-442d-a108-6b2c141bbc9d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84452024-11-02T04:09:11.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bd16d3bf-e960-442d-a108-6b2c141bbc9d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84462024-11-02T04:09:11.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bd16d3bf-e960-442d-a108-6b2c141bbc9d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84472024-11-02T04:09:12.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06bdaef4-7796-4617-811c-a0446c1ba100 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84482024-11-02T04:09:12.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06bdaef4-7796-4617-811c-a0446c1ba100 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84492024-11-02T04:09:12.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 06bdaef4-7796-4617-811c-a0446c1ba100 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84502024-11-02T04:09:13.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7fa637e-3a8a-4f00-95d5-114955aac25a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84512024-11-02T04:09:13.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7fa637e-3a8a-4f00-95d5-114955aac25a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84522024-11-02T04:09:13.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7fa637e-3a8a-4f00-95d5-114955aac25a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
84532024-11-02T04:09:13.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
84542024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
84552024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84562024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
84572024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84582024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84592024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
84602024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
84612024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84622024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84632024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84642024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
84652024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
84662024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
84672024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84682024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84692024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84702024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84712024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
84722024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
84732024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84742024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84752024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
84762024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84772024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
84782024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84792024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
84802024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84812024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
84822024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84832024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
84842024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
84852024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
84862024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
84872024-11-02T04:09:13.544ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
84882024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.95\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
84892024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
84902024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
84912024-11-02T04:09:13.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84922024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84932024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84942024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84952024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
84962024-11-02T04:09:13.544ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84972024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84982024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
84992024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
85002024-11-02T04:09:13.544ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 03:59:13.544340532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
85012024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
85022024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
85032024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
85042024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
85052024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85062024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.261\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85072024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
85082024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
85092024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.5\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85102024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
85112024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
85122024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.3\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
85132024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
85142024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85152024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
85162024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.11\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
85172024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85182024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85192024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85202024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85212024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85222024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85232024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85242024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85252024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85262024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85272024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85282024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85292024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85302024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85312024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85322024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85332024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85342024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85352024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
85362024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85372024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85382024-11-02T04:09:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85392024-11-02T04:09:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 10057, tv_nsec: 519647002 } })
85402024-11-02T04:09:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 10057, tv_nsec: 519685343 } })
85412024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85422024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85432024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85442024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85452024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85462024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85472024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
85482024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.436011ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
85492024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
85502024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.447841ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
85512024-11-02T04:09:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85522024-11-02T04:09:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.748169ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85532024-11-02T04:09:13.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85542024-11-02T04:09:13.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10057, tv_nsec: 523223419 } })
85552024-11-02T04:09:13.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
85562024-11-02T04:09:13.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85572024-11-02T04:09:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85582024-11-02T04:09:13.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10057, tv_nsec: 524932946 } })
85592024-11-02T04:09:13.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85602024-11-02T04:09:13.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
85612024-11-02T04:09:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85622024-11-02T04:09:13.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85632024-11-02T04:09:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85642024-11-02T04:09:13.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 35324b2b-c49f-40c5-927b-1a313c1c39cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
85652024-11-02T04:09:13.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 35324b2b-c49f-40c5-927b-1a313c1c39cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
85662024-11-02T04:09:13.552ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85672024-11-02T04:09:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85682024-11-02T04:09:13.553ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85692024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85702024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85712024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85732024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85742024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85752024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85762024-11-02T04:09:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85772024-11-02T04:09:13.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85782024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85792024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85802024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85812024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85822024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85832024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
85842024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85852024-11-02T04:09:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85862024-11-02T04:09:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85872024-11-02T04:09:13.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85882024-11-02T04:09:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85892024-11-02T04:09:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85902024-11-02T04:09:13.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85912024-11-02T04:09:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85922024-11-02T04:09:13.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-11-02T04:09:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85942024-11-02T04:09:13.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85952024-11-02T04:09:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85962024-11-02T04:09:13.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85972024-11-02T04:09:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85982024-11-02T04:09:13.561ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85992024-11-02T04:09:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86002024-11-02T04:09:13.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86012024-11-02T04:09:13.567ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.014554ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
86022024-11-02T04:09:13.569ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 03:59:13.544340532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
86032024-11-02T04:09:13.569ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.947336ms iteration = 13 status = {"expiration":"2024-11-02T03:59:13.544340532Z","pruned":[]}
86042024-11-02T04:09:13.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86052024-11-02T04:09:13.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86062024-11-02T04:09:13.571ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
86072024-11-02T04:09:13.571ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
86082024-11-02T04:09:13.571ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 27.147663ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
86092024-11-02T04:09:13.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10057, tv_nsec: 546708044 } })
86102024-11-02T04:09:13.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
86112024-11-02T04:09:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86122024-11-02T04:09:13.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86132024-11-02T04:09:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86142024-11-02T04:09:13.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86152024-11-02T04:09:13.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 21449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 35324b2b-c49f-40c5-927b-1a313c1c39cb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86162024-11-02T04:09:13.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86172024-11-02T04:09:13.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86182024-11-02T04:09:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86192024-11-02T04:09:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86202024-11-02T04:09:13.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86212024-11-02T04:09:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86222024-11-02T04:09:13.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86232024-11-02T04:09:13.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86242024-11-02T04:09:13.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86252024-11-02T04:09:13.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86262024-11-02T04:09:13.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272024-11-02T04:09:13.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86282024-11-02T04:09:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86292024-11-02T04:09:13.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86302024-11-02T04:09:13.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86312024-11-02T04:09:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86322024-11-02T04:09:13.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86332024-11-02T04:09:13.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86342024-11-02T04:09:13.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86352024-11-02T04:09:13.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86362024-11-02T04:09:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86372024-11-02T04:09:13.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86382024-11-02T04:09:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86392024-11-02T04:09:13.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86402024-11-02T04:09:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86412024-11-02T04:09:13.587ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86422024-11-02T04:09:13.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.325621ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86432024-11-02T04:09:13.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86442024-11-02T04:09:13.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86452024-11-02T04:09:13.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86462024-11-02T04:09:13.589ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 44.864314ms iteration = 6 status = {"nsuccess":5}
86472024-11-02T04:09:13.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482024-11-02T04:09:13.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86492024-11-02T04:09:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86502024-11-02T04:09:13.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86512024-11-02T04:09:13.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86522024-11-02T04:09:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86532024-11-02T04:09:13.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86542024-11-02T04:09:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86552024-11-02T04:09:13.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86562024-11-02T04:09:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86572024-11-02T04:09:13.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.476803ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86582024-11-02T04:09:13.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.571435ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86592024-11-02T04:09:13.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86602024-11-02T04:09:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86612024-11-02T04:09:13.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86622024-11-02T04:09:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86632024-11-02T04:09:13.627ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86642024-11-02T04:09:13.627ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86652024-11-02T04:09:13.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86662024-11-02T04:09:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86672024-11-02T04:09:13.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86682024-11-02T04:09:13.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86692024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86702024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86712024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86722024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86732024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86742024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86752024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86762024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86772024-11-02T04:09:13.634ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86782024-11-02T04:09:13.634ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.601346ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86792024-11-02T04:09:13.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86802024-11-02T04:09:13.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86812024-11-02T04:09:13.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86822024-11-02T04:09:13.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86832024-11-02T04:09:13.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86842024-11-02T04:09:13.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86852024-11-02T04:09:13.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86862024-11-02T04:09:13.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86872024-11-02T04:09:13.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
86882024-11-02T04:09:13.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86892024-11-02T04:09:13.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86902024-11-02T04:09:13.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86912024-11-02T04:09:13.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86922024-11-02T04:09:13.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86932024-11-02T04:09:13.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86942024-11-02T04:09:13.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86952024-11-02T04:09:13.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86962024-11-02T04:09:13.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86972024-11-02T04:09:13.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86982024-11-02T04:09:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
86992024-11-02T04:09:13.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87002024-11-02T04:09:13.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87012024-11-02T04:09:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87022024-11-02T04:09:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87032024-11-02T04:09:13.650ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.309693ms iteration = 25 status = 0
87042024-11-02T04:09:13.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
87052024-11-02T04:09:13.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.794569ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
87062024-11-02T04:09:13.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87072024-11-02T04:09:13.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87082024-11-02T04:09:13.663ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87092024-11-02T04:09:13.663ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87102024-11-02T04:09:13.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.116018ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87112024-11-02T04:09:13.667ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
87122024-11-02T04:09:13.667ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
87132024-11-02T04:09:13.667ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
87142024-11-02T04:09:13.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87152024-11-02T04:09:13.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87162024-11-02T04:09:13.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
87172024-11-02T04:09:13.684ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
87182024-11-02T04:09:13.684ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
87192024-11-02T04:09:13.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87202024-11-02T04:09:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87212024-11-02T04:09:13.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87222024-11-02T04:09:13.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87232024-11-02T04:09:13.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87242024-11-02T04:09:13.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87252024-11-02T04:09:13.708ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
87262024-11-02T04:09:13.708ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87272024-11-02T04:09:13.708ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29190202-4f32-45e1-8fe2-f51563b02d51", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87282024-11-02T04:09:13.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87292024-11-02T04:09:13.708ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.747189ms iteration = 29 status = {"physical_disks_added":0}
87302024-11-02T04:09:13.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87312024-11-02T04:09:13.793ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
87322024-11-02T04:09:13.793ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87332024-11-02T04:09:13.793ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56ab7a57-2922-4af3-88f0-b768b052eaa0", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87342024-11-02T04:09:13.793ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87352024-11-02T04:09:13.795ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
87362024-11-02T04:09:13.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87372024-11-02T04:09:13.887ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87382024-11-02T04:09:13.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87392024-11-02T04:09:13.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
87402024-11-02T04:09:13.902ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87412024-11-02T04:09:13.903ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed16c610-2ec6-4d0d-b704-a060e3a45205", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87422024-11-02T04:09:13.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87432024-11-02T04:09:13.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87442024-11-02T04:09:13.937ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.970801ms iteration = 25 status = {}
87452024-11-02T04:09:13.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87462024-11-02T04:09:13.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ad1c8d-3307-467f-bc39-5417fd704198", "content-length": "372", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87472024-11-02T04:09:13.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87482024-11-02T04:09:13.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a90a7f94-091e-4478-883d-182645adfa9d", "content-length": "691", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87492024-11-02T04:09:13.984ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87502024-11-02T04:09:13.984ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87512024-11-02T04:09:13.984ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87522024-11-02T04:09:13.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87532024-11-02T04:09:13.986ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 442.246478ms iteration = 25 status = {}
87542024-11-02T04:09:13.986ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87552024-11-02T04:09:14.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87562024-11-02T04:09:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87572024-11-02T04:09:14.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87582024-11-02T04:09:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87592024-11-02T04:09:14.025ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
87602024-11-02T04:09:14.025ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 481.171844ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87612024-11-02T04:09:14.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622024-11-02T04:09:14.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87632024-11-02T04:09:14.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87642024-11-02T04:09:14.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87652024-11-02T04:09:14.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87662024-11-02T04:09:14.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "28997251-dc71-4fcb-b93d-891a477a160d", "date": "Sat, 02 Nov 2024 04:09:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87672024-11-02T04:09:14.033ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87682024-11-02T04:09:14.035ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
87692024-11-02T04:09:14.035ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
87702024-11-02T04:09:14.035ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
87712024-11-02T04:09:14.035ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 490.827831ms iteration = 14 status = {"generation":2}
87722024-11-02T04:09:14.036ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e43172ce-edc4-4aff-a6e7-c1d5a0d43e17", "date": "Sat, 02 Nov 2024 04:09:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87732024-11-02T04:09:14.036ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87742024-11-02T04:09:14.038ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87752024-11-02T04:09:14.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 494.236084ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87762024-11-02T04:09:14.039ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87772024-11-02T04:09:14.039ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1e847ce-3a1e-4184-89fd-c50d22df3f32", "content-length": "1", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87782024-11-02T04:09:14.041ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87792024-11-02T04:09:14.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87802024-11-02T04:09:14.042ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87812024-11-02T04:09:14.042ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87822024-11-02T04:09:14.042ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "703c27dd-d67a-490f-a205-7eadb19f3038", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87832024-11-02T04:09:14.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87842024-11-02T04:09:14.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87852024-11-02T04:09:14.043ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 499.841494ms iteration = 25 status = null
87862024-11-02T04:09:14.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87872024-11-02T04:09:14.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87882024-11-02T04:09:14.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87892024-11-02T04:09:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902024-11-02T04:09:14.052ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87912024-11-02T04:09:14.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87922024-11-02T04:09:14.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4350ca9f-ce2e-4fc8-a52d-f8b64683b7fd", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
87932024-11-02T04:09:14.054ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 510.552274ms iteration = 26 status = {}
87942024-11-02T04:09:14.059ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
87952024-11-02T04:09:14.059ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
87962024-11-02T04:09:14.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87972024-11-02T04:09:14.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87982024-11-02T04:09:14.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87992024-11-02T04:09:14.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88002024-11-02T04:09:14.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88012024-11-02T04:09:14.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88022024-11-02T04:09:14.066ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
88032024-11-02T04:09:14.066ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
88042024-11-02T04:09:14.066ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
88052024-11-02T04:09:14.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 522.49443ms iteration = 14 status = {"generation":1}
88062024-11-02T04:09:14.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
88072024-11-02T04:09:14.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9b448483-700c-486c-a145-b63ae1881372", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88082024-11-02T04:09:14.072ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88092024-11-02T04:09:14.074ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "91cc6317-c883-4eea-b347-478f132256a3", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88102024-11-02T04:09:14.074ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88112024-11-02T04:09:14.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "28a65d8e-deed-471e-a681-25fa31fded84", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88122024-11-02T04:09:14.076ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88132024-11-02T04:09:14.078ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
88142024-11-02T04:09:14.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 533.914897ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88152024-11-02T04:09:14.096ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
88162024-11-02T04:09:14.096ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 551.923503ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
88172024-11-02T04:09:14.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88182024-11-02T04:09:14.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88192024-11-02T04:09:14.108ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
88202024-11-02T04:09:14.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88212024-11-02T04:09:14.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88222024-11-02T04:09:14.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88232024-11-02T04:09:14.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fe97b4c-92f9-404f-ad63-5f43dc73542c", "content-length": "134", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
88242024-11-02T04:09:14.118ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88252024-11-02T04:09:14.118ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
88262024-11-02T04:09:14.118ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88272024-11-02T04:09:14.118ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88282024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88292024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88302024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88312024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88322024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88332024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88342024-11-02T04:09:14.119ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
88352024-11-02T04:09:14.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88362024-11-02T04:09:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88372024-11-02T04:09:14.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88382024-11-02T04:09:14.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1f516cc-221f-43e8-895e-5c407d5a7d7f", "content-length": "2", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
88392024-11-02T04:09:14.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88402024-11-02T04:09:14.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "169e3db1-0088-4144-a66e-594a6f7cd06e", "content-length": "52", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
88412024-11-02T04:09:14.121ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
88422024-11-02T04:09:14.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88432024-11-02T04:09:14.241ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "547da329-5809-487b-96e5-93a5c2b29b40", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
88442024-11-02T04:09:14.241ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
88452024-11-02T04:09:14.241ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88462024-11-02T04:09:14.241ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9b1d966-3755-4101-acc0-51b537c9e2ff", "content-length": "682", "date": "Sat, 02 Nov 2024 04:09:13 GMT"} })
88472024-11-02T04:09:14.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88482024-11-02T04:09:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88492024-11-02T04:09:14.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88502024-11-02T04:09:14.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88512024-11-02T04:09:14.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88522024-11-02T04:09:14.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88532024-11-02T04:09:14.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88542024-11-02T04:09:14.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88552024-11-02T04:09:14.258ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 714.788621ms iteration = 25 status = {}
88562024-11-02T04:09:14.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d5500d3-94f2-4790-ab55-d88888a21923 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88572024-11-02T04:09:14.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d5500d3-94f2-4790-ab55-d88888a21923 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88582024-11-02T04:09:14.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d5500d3-94f2-4790-ab55-d88888a21923 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88592024-11-02T04:09:15.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d24f9917-1fcc-4b5e-b365-fbaa82c90b6d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88602024-11-02T04:09:15.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d24f9917-1fcc-4b5e-b365-fbaa82c90b6d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88612024-11-02T04:09:15.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d24f9917-1fcc-4b5e-b365-fbaa82c90b6d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88622024-11-02T04:09:15.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b4f7df62-e733-498a-adde-fcdde693d5a5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88632024-11-02T04:09:15.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b4f7df62-e733-498a-adde-fcdde693d5a5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88642024-11-02T04:09:15.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = b4f7df62-e733-498a-adde-fcdde693d5a5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
88652024-11-02T04:09:15.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = eb5a2e91-877b-4b6c-b748-87ee4e4cb511 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
88662024-11-02T04:09:15.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = eb5a2e91-877b-4b6c-b748-87ee4e4cb511 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
88672024-11-02T04:09:15.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = eb5a2e91-877b-4b6c-b748-87ee4e4cb511 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
88682024-11-02T04:09:16.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a728c5ef-5d18-4f7d-8640-897d0a2dd83d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88692024-11-02T04:09:16.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a728c5ef-5d18-4f7d-8640-897d0a2dd83d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88702024-11-02T04:09:16.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a728c5ef-5d18-4f7d-8640-897d0a2dd83d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88712024-11-02T04:09:17.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ee349e8-3532-43f8-8d94-05486b710982 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88722024-11-02T04:09:17.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ee349e8-3532-43f8-8d94-05486b710982 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88732024-11-02T04:09:17.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ee349e8-3532-43f8-8d94-05486b710982 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88742024-11-02T04:09:18.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b02ee9c8-4f38-4b9d-aecb-8ce2c35b0157 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88752024-11-02T04:09:18.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b02ee9c8-4f38-4b9d-aecb-8ce2c35b0157 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88762024-11-02T04:09:18.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b02ee9c8-4f38-4b9d-aecb-8ce2c35b0157 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88772024-11-02T04:09:19.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8949a5-a7f5-4b69-b53a-e427106d937c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88782024-11-02T04:09:19.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8949a5-a7f5-4b69-b53a-e427106d937c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88792024-11-02T04:09:19.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fb8949a5-a7f5-4b69-b53a-e427106d937c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88802024-11-02T04:09:20.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 682aaf2b-70b2-4fa2-81fd-1c8f010498d7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88812024-11-02T04:09:20.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 682aaf2b-70b2-4fa2-81fd-1c8f010498d7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88822024-11-02T04:09:20.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 682aaf2b-70b2-4fa2-81fd-1c8f010498d7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88832024-11-02T04:09:21.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff577d0-bf71-4790-a00c-5daab5a82b7d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88842024-11-02T04:09:21.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff577d0-bf71-4790-a00c-5daab5a82b7d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88852024-11-02T04:09:21.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff577d0-bf71-4790-a00c-5daab5a82b7d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88862024-11-02T04:09:22.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7ac2193-3ae4-4936-a843-00176e56eb01 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88872024-11-02T04:09:22.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7ac2193-3ae4-4936-a843-00176e56eb01 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88882024-11-02T04:09:22.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7ac2193-3ae4-4936-a843-00176e56eb01 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
88892024-11-02T04:09:23.051ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff02222-46bf-48c5-8852-13056004f6e0 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-02T04:09:23.045842974Z }
88902024-11-02T04:09:23.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff02222-46bf-48c5-8852-13056004f6e0 roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
88912024-11-02T04:09:23.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff02222-46bf-48c5-8852-13056004f6e0 resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
88922024-11-02T04:09:23.080ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:62764
88932024-11-02T04:09:23.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62764 req_id = e32393aa-39b9-4cf2-aa54-ed5f0a43e4c9 roles = RoleSet { roles: {} } uri = /metrics/producers
88942024-11-02T04:09:23.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62764 req_id = e32393aa-39b9-4cf2-aa54-ed5f0a43e4c9 resource = Database result = Ok(()) uri = /metrics/producers
88952024-11-02T04:09:23.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46819 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4ff02222-46bf-48c5-8852-13056004f6e0 response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
88962024-11-02T04:09:23.100ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3c6d6745-6712-48ee-a029-29ef6c378409 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-02T04:09:23.100503678Z }
88972024-11-02T04:09:23.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3c6d6745-6712-48ee-a029-29ef6c378409 roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
88982024-11-02T04:09:23.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3c6d6745-6712-48ee-a029-29ef6c378409 resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
88992024-11-02T04:09:23.116ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 70aeba8a-4066-4620-bb46-a15fa016442a
89002024-11-02T04:09:23.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35966 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:62764 req_id = e32393aa-39b9-4cf2-aa54-ed5f0a43e4c9 response_code = 201 uri = /metrics/producers
89012024-11-02T04:09:23.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30829 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3c6d6745-6712-48ee-a029-29ef6c378409 response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89022024-11-02T04:09:23.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0823cc85-6354-4a93-b952-a4135a5c0990 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89032024-11-02T04:09:23.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0823cc85-6354-4a93-b952-a4135a5c0990 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89042024-11-02T04:09:23.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0823cc85-6354-4a93-b952-a4135a5c0990 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89052024-11-02T04:09:23.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
89062024-11-02T04:09:23.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89072024-11-02T04:09:23.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
89082024-11-02T04:09:23.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89092024-11-02T04:09:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89102024-11-02T04:09:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89112024-11-02T04:09:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89122024-11-02T04:09:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89132024-11-02T04:09:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89142024-11-02T04:09:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89152024-11-02T04:09:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89162024-11-02T04:09:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89172024-11-02T04:09:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182024-11-02T04:09:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
89192024-11-02T04:09:23.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89202024-11-02T04:09:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89212024-11-02T04:09:23.568ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
89222024-11-02T04:09:23.568ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.18929ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
89232024-11-02T04:09:23.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89242024-11-02T04:09:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89252024-11-02T04:09:23.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.217831ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89262024-11-02T04:09:23.918ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1336 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 1e14c472-f121-4901-a17f-8cf221798173 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
89272024-11-02T04:09:24.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 681841be-723a-4c0b-bf22-b1151ffbd17b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89282024-11-02T04:09:24.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 681841be-723a-4c0b-bf22-b1151ffbd17b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89292024-11-02T04:09:24.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 681841be-723a-4c0b-bf22-b1151ffbd17b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89302024-11-02T04:09:25.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7df7c53a-888f-4cdb-a6b1-e8ced237d00d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89312024-11-02T04:09:25.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7df7c53a-888f-4cdb-a6b1-e8ced237d00d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89322024-11-02T04:09:25.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7df7c53a-888f-4cdb-a6b1-e8ced237d00d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89332024-11-02T04:09:26.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3976d5e4-0bc7-4a2f-864d-733e6ffe1bca roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89342024-11-02T04:09:26.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3976d5e4-0bc7-4a2f-864d-733e6ffe1bca resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89352024-11-02T04:09:26.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3976d5e4-0bc7-4a2f-864d-733e6ffe1bca response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89362024-11-02T04:09:27.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53c5c482-a821-45c5-ae96-f014a405f570 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89372024-11-02T04:09:27.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53c5c482-a821-45c5-ae96-f014a405f570 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89382024-11-02T04:09:27.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 53c5c482-a821-45c5-ae96-f014a405f570 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89392024-11-02T04:09:28.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e283fc3-9c23-4243-b5d5-885407feb827 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89402024-11-02T04:09:28.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e283fc3-9c23-4243-b5d5-885407feb827 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89412024-11-02T04:09:28.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e283fc3-9c23-4243-b5d5-885407feb827 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89422024-11-02T04:09:29.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c776f5e-bf85-4d17-9360-4c548fd30de1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89432024-11-02T04:09:29.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c776f5e-bf85-4d17-9360-4c548fd30de1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89442024-11-02T04:09:29.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1c776f5e-bf85-4d17-9360-4c548fd30de1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89452024-11-02T04:09:30.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44049493-bf85-4232-921e-efd6533434b6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89462024-11-02T04:09:30.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44049493-bf85-4232-921e-efd6533434b6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89472024-11-02T04:09:30.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 44049493-bf85-4232-921e-efd6533434b6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89482024-11-02T04:09:31.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1a903a2-62af-4f9e-8b19-5abe29cdb7d5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89492024-11-02T04:09:31.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1a903a2-62af-4f9e-8b19-5abe29cdb7d5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89502024-11-02T04:09:31.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a1a903a2-62af-4f9e-8b19-5abe29cdb7d5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89512024-11-02T04:09:32.596ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d3c0e65b-f427-4ab4-86f6-247928a93504 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-02T04:09:32.596695427Z }
89522024-11-02T04:09:32.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d3c0e65b-f427-4ab4-86f6-247928a93504 roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89532024-11-02T04:09:32.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d3c0e65b-f427-4ab4-86f6-247928a93504 resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89542024-11-02T04:09:32.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7856 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d3c0e65b-f427-4ab4-86f6-247928a93504 response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89552024-11-02T04:09:32.605ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c61acdb2-1fd0-4fbf-abe2-faaab2b75642 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-11-02T04:09:32.605407344Z }
89562024-11-02T04:09:32.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c61acdb2-1fd0-4fbf-abe2-faaab2b75642 roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89572024-11-02T04:09:32.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c61acdb2-1fd0-4fbf-abe2-faaab2b75642 resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89582024-11-02T04:09:32.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35466 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c61acdb2-1fd0-4fbf-abe2-faaab2b75642 response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
89592024-11-02T04:09:32.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c22785f2-4b2e-40b4-81e2-801942a67fb1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89602024-11-02T04:09:32.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c22785f2-4b2e-40b4-81e2-801942a67fb1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89612024-11-02T04:09:32.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c22785f2-4b2e-40b4-81e2-801942a67fb1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89622024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
89632024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
89642024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89652024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89662024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89672024-11-02T04:09:33.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89682024-11-02T04:09:33.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692024-11-02T04:09:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89702024-11-02T04:09:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89712024-11-02T04:09:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89722024-11-02T04:09:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89732024-11-02T04:09:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89742024-11-02T04:09:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89752024-11-02T04:09:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
89762024-11-02T04:09:33.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89772024-11-02T04:09:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89782024-11-02T04:09:33.569ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
89792024-11-02T04:09:33.569ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.1119ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
89802024-11-02T04:09:33.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89812024-11-02T04:09:33.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89822024-11-02T04:09:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.230132ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89832024-11-02T04:09:33.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a1f17fc4-db9f-4651-9b6e-556b712e985b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
89842024-11-02T04:09:33.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a1f17fc4-db9f-4651-9b6e-556b712e985b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
89852024-11-02T04:09:33.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = a1f17fc4-db9f-4651-9b6e-556b712e985b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
89862024-11-02T04:09:33.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 6cda2b9b-29fc-4e0e-bf56-e7817c6fe414 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
89872024-11-02T04:09:33.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 6cda2b9b-29fc-4e0e-bf56-e7817c6fe414 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
89882024-11-02T04:09:33.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 6cda2b9b-29fc-4e0e-bf56-e7817c6fe414 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
89892024-11-02T04:09:33.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59bdc4cd-4267-4d53-b948-39e80b54ddf3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89902024-11-02T04:09:33.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59bdc4cd-4267-4d53-b948-39e80b54ddf3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89912024-11-02T04:09:33.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59bdc4cd-4267-4d53-b948-39e80b54ddf3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89922024-11-02T04:09:34.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 5b706ff2-622d-440a-a4cc-fddfaab085a0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
89932024-11-02T04:09:34.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 5b706ff2-622d-440a-a4cc-fddfaab085a0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
89942024-11-02T04:09:34.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 5b706ff2-622d-440a-a4cc-fddfaab085a0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
89952024-11-02T04:09:34.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43134e95-398d-4e3c-9b21-513a0132f74e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89962024-11-02T04:09:34.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43134e95-398d-4e3c-9b21-513a0132f74e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89972024-11-02T04:09:34.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 43134e95-398d-4e3c-9b21-513a0132f74e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
89982024-11-02T04:09:35.073ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-11-02T04:09:35.072684931Z }
89992024-11-02T04:09:35.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90002024-11-02T04:09:35.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90012024-11-02T04:09:35.085ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_needs_update = true
90022024-11-02T04:09:35.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90032024-11-02T04:09:35.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90042024-11-02T04:09:35.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90052024-11-02T04:09:35.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90062024-11-02T04:09:35.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90072024-11-02T04:09:35.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90082024-11-02T04:09:35.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90092024-11-02T04:09:35.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90102024-11-02T04:09:35.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90112024-11-02T04:09:35.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90122024-11-02T04:09:35.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90132024-11-02T04:09:35.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90142024-11-02T04:09:35.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90152024-11-02T04:09:35.134ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73ce13ac-7ea3-466e-9d78-11e4419419eb, lookup_type: ById(73ce13ac-7ea3-466e-9d78-11e4419419eb) }, key: 453d9a68-e399-48d9-9ee3-b25d4e917610, lookup_type: ById(453d9a68-e399-48d9-9ee3-b25d4e917610) }, key: 70aeba8a-4066-4620-bb46-a15fa016442a, lookup_type: ById(70aeba8a-4066-4620-bb46-a15fa016442a) } result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90162024-11-02T04:09:35.134ZINFOnexus (dropshot_internal): starting update saga for 70aeba8a-4066-4620-bb46-a15fa016442a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-11-02T04:09:35.072684931Z }
90172024-11-02T04:09:35.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61478 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90182024-11-02T04:09:35.135ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97a034c9-325d-422e-8bd4-651b48ea1b11 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-11-02T04:09:35.072684931Z }
90192024-11-02T04:09:35.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97a034c9-325d-422e-8bd4-651b48ea1b11 roles = RoleSet { roles: {} } uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90202024-11-02T04:09:35.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97a034c9-325d-422e-8bd4-651b48ea1b11 resource = Database result = Ok(()) uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90212024-11-02T04:09:35.136ZDEBGnexus (dropshot_internal): preparing instance-update saga for 70aeba8a-4066-4620-bb46-a15fa016442a... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee48459a-dc8d-4445-816d-7f7dfdd8f14b uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90222024-11-02T04:09:35.136ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update
90232024-11-02T04:09:35.136ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"70aeba8a-4066-4620-bb46-a15fa016442a","lookup_type":{"ById":"70aeba8a-4066-4620-bb46-a15fa016442a"},"parent":{"key":"453d9a68-e399-48d9-9ee3-b25d4e917610","lookup_type":{"ById":"453d9a68-e399-48d9-9ee3-b25d4e917610"},"parent":{"key":"73ce13ac-7ea3-466e-9d78-11e4419419eb","lookup_type":{"ById":"73ce13ac-7ea3-466e-9d78-11e4419419eb"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90242024-11-02T04:09:35.136ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update
90252024-11-02T04:09:35.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4533 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97a034c9-325d-422e-8bd4-651b48ea1b11 response_code = 204 uri = /vmms/ae2b4e8c-8f07-47d2-b46e-f505dadf6695
90262024-11-02T04:09:35.167ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update
90272024-11-02T04:09:35.168ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90282024-11-02T04:09:35.168ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90292024-11-02T04:09:35.168ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90302024-11-02T04:09:35.171ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90312024-11-02T04:09:35.171ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90322024-11-02T04:09:35.175ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90332024-11-02T04:09:35.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90342024-11-02T04:09:35.179ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90352024-11-02T04:09:35.179ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("8e098265-a949-4d81-92c6-8a115bdfd37b")) node_id = 0 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90362024-11-02T04:09:35.182ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90372024-11-02T04:09:35.182ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90382024-11-02T04:09:35.190ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update
90392024-11-02T04:09:35.190ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90402024-11-02T04:09:35.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90412024-11-02T04:09:35.192ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90422024-11-02T04:09:35.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90432024-11-02T04:09:35.194ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90442024-11-02T04:09:35.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90452024-11-02T04:09:35.196ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90462024-11-02T04:09:35.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90472024-11-02T04:09:35.197ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90482024-11-02T04:09:35.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90492024-11-02T04:09:35.199ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90502024-11-02T04:09:35.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90512024-11-02T04:09:35.200ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90522024-11-02T04:09:35.203ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73ce13ac-7ea3-466e-9d78-11e4419419eb, lookup_type: ById(73ce13ac-7ea3-466e-9d78-11e4419419eb) }, key: 453d9a68-e399-48d9-9ee3-b25d4e917610, lookup_type: ById(453d9a68-e399-48d9-9ee3-b25d4e917610) }, key: 70aeba8a-4066-4620-bb46-a15fa016442a, lookup_type: ById(70aeba8a-4066-4620-bb46-a15fa016442a) } result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90532024-11-02T04:09:35.203ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance updater_id = 8e098265-a949-4d81-92c6-8a115bdfd37b
90542024-11-02T04:09:35.203ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90552024-11-02T04:09:35.203ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90562024-11-02T04:09:35.216ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance updater_id = 8e098265-a949-4d81-92c6-8a115bdfd37b
90572024-11-02T04:09:35.216ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90582024-11-02T04:09:35.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance
90592024-11-02T04:09:35.221ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a locked_gen = Generation(Generation(2)) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = LockInstance updater_id = 8e098265-a949-4d81-92c6-8a115bdfd37b
90602024-11-02T04:09:35.221ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90612024-11-02T04:09:35.221ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8e098265-a949-4d81-92c6-8a115bdfd37b")}) node_id = 1 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90622024-11-02T04:09:35.225ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90632024-11-02T04:09:35.225ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
90642024-11-02T04:09:35.229ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90652024-11-02T04:09:35.229ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90662024-11-02T04:09:35.233ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90672024-11-02T04:09:35.233ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90682024-11-02T04:09:35.234ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90692024-11-02T04:09:35.234ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90702024-11-02T04:09:35.236ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90712024-11-02T04:09:35.239ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73ce13ac-7ea3-466e-9d78-11e4419419eb, lookup_type: ById(73ce13ac-7ea3-466e-9d78-11e4419419eb) }, key: 453d9a68-e399-48d9-9ee3-b25d4e917610, lookup_type: ById(453d9a68-e399-48d9-9ee3-b25d4e917610) }, key: 70aeba8a-4066-4620-bb46-a15fa016442a, lookup_type: ById(70aeba8a-4066-4620-bb46-a15fa016442a) } result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90722024-11-02T04:09:35.239ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90732024-11-02T04:09:35.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
90742024-11-02T04:09:35.244ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: ae2b4e8c-8f07-47d2-b46e-f505dadf6695, time_created: 2024-11-02T04:09:14.687053Z, time_deleted: None, instance_id: 70aeba8a-4066-4620-bb46-a15fa016442a, sled_id: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-02T04:09:35.072684Z, gen: Generation(Generation(9)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-02T04:09:11.939878Z, gen: Generation(Generation(3)), propolis_id: Some(ae2b4e8c-8f07-47d2-b46e-f505dadf6695), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(ae2b4e8c-8f07-47d2-b46e-f505dadf6695 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-02T04:09:35.244658084Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
90752024-11-02T04:09:35.247ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
90762024-11-02T04:09:35.247ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"70aeba8a-4066-4620-bb46-a15fa016442a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"ae2b4e8c-8f07-47d2-b46e-f505dadf6695"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"70aeba8a-4066-4620-bb46-a15fa016442a","lookup_type":{"ById":"70aeba8a-4066-4620-bb46-a15fa016442a"},"parent":{"key":"453d9a68-e399-48d9-9ee3-b25d4e917610","lookup_type":{"ById":"453d9a68-e399-48d9-9ee3-b25d4e917610"},"parent":{"key":"73ce13ac-7ea3-466e-9d78-11e4419419eb","lookup_type":{"ById":"73ce13ac-7ea3-466e-9d78-11e4419419eb"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"8e098265-a949-4d81-92c6-8a115bdfd37b"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"453d9a68-e399-48d9-9ee3-b25d4e917610","ram_diff":1073741824},"destroy_active_vmm":"ae2b4e8c-8f07-47d2-b46e-f505dadf6695","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-02T04:09:35.244658084Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90772024-11-02T04:09:35.247ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
90782024-11-02T04:09:35.250ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
90792024-11-02T04:09:35.250ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90802024-11-02T04:09:35.250ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90812024-11-02T04:09:35.250ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90822024-11-02T04:09:35.253ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90832024-11-02T04:09:35.253ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90842024-11-02T04:09:35.256ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90852024-11-02T04:09:35.257ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90862024-11-02T04:09:35.259ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90872024-11-02T04:09:35.259ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("91f58c04-da12-427f-98b6-be01743c0648")) node_id = 0 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90882024-11-02T04:09:35.263ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90892024-11-02T04:09:35.263ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90902024-11-02T04:09:35.270ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a parent_lock = UpdaterLock { updater_id: 8e098265-a949-4d81-92c6-8a115bdfd37b, locked_gen: Generation(Generation(2)) } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
90912024-11-02T04:09:35.270ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = BecomeUpdater
90922024-11-02T04:09:35.270ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = BecomeUpdater
90932024-11-02T04:09:35.284ZDEBGnexus (SagaExecutor): inherited lock from 8e098265-a949-4d81-92c6-8a115bdfd37b to 91f58c04-da12-427f-98b6-be01743c0648 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 8e098265-a949-4d81-92c6-8a115bdfd37b saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = BecomeUpdater updater_id = 91f58c04-da12-427f-98b6-be01743c0648
90942024-11-02T04:09:35.285ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
90952024-11-02T04:09:35.285ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90962024-11-02T04:09:35.285ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("91f58c04-da12-427f-98b6-be01743c0648")}) node_id = 1 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90972024-11-02T04:09:35.288ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
90982024-11-02T04:09:35.288ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
90992024-11-02T04:09:35.291ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91002024-11-02T04:09:35.291ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91012024-11-02T04:09:35.294ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91022024-11-02T04:09:35.294ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91032024-11-02T04:09:35.297ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91042024-11-02T04:09:35.300ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a
91052024-11-02T04:09:35.302ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91062024-11-02T04:09:35.303ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91072024-11-02T04:09:35.304ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91082024-11-02T04:09:35.305ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91092024-11-02T04:09:35.306ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
91102024-11-02T04:09:35.306ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91112024-11-02T04:09:35.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UpdateNetworkConfig
91122024-11-02T04:09:35.309ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
91132024-11-02T04:09:35.309ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
91142024-11-02T04:09:35.309ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
91152024-11-02T04:09:35.310ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
91162024-11-02T04:09:35.311ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
91172024-11-02T04:09:35.311ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
91182024-11-02T04:09:35.311ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
91192024-11-02T04:09:35.315ZDEBGnexus: notifying dendrite of updates instance_id = Some(70aeba8a-4066-4620-bb46-a15fa016442a (instance)) switch = switch0
91202024-11-02T04:09:35.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10079, tv_nsec: 290052684 } })
91212024-11-02T04:09:35.315ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
91222024-11-02T04:09:35.345ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
91232024-11-02T04:09:35.345ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91242024-11-02T04:09:35.345ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "466603aa-8ddc-4a9c-abb4-d2264d8fc863", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
91252024-11-02T04:09:35.345ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91262024-11-02T04:09:35.346ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91272024-11-02T04:09:35.375ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
91282024-11-02T04:09:35.375ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e45650f-e13b-4ba5-bfe1-bab6c60b8bda", "content-length": "4", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
91292024-11-02T04:09:35.376ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91302024-11-02T04:09:35.376ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91312024-11-02T04:09:35.379ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91322024-11-02T04:09:35.379ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91332024-11-02T04:09:35.382ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
91342024-11-02T04:09:35.382ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
91352024-11-02T04:09:35.395ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-02T04:09:35.385551Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 453d9a68-e399-48d9-9ee3-b25d4e917610, time_modified: Some(2024-11-02T04:09:35.385551Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, time_modified: Some(2024-11-02T04:09:35.385551Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91362024-11-02T04:09:35.395ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91372024-11-02T04:09:35.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91382024-11-02T04:09:35.399ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91392024-11-02T04:09:35.399ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91402024-11-02T04:09:35.402ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91412024-11-02T04:09:35.402ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UnassignOximeterProducer
91422024-11-02T04:09:35.402ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UnassignOximeterProducer
91432024-11-02T04:09:35.409ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 producer_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91442024-11-02T04:09:35.409ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UnassignOximeterProducer
91452024-11-02T04:09:35.409ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = UnassignOximeterProducer
91462024-11-02T04:09:35.448ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91472024-11-02T04:09:35.451ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/70aeba8a-4066-4620-bb46-a15fa016442a
91482024-11-02T04:09:35.465ZDEBGnexus (SagaExecutor): client response oximeter-collector = 70aeba8a-4066-4620-bb46-a15fa016442a result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/70aeba8a-4066-4620-bb46-a15fa016442a", status: 204, headers: {"x-request-id": "28729d41-bfaa-48d9-85da-48b6f263b66d", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} }) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91492024-11-02T04:09:35.465ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 producer_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91502024-11-02T04:09:35.466ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91512024-11-02T04:09:35.466ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91522024-11-02T04:09:35.470ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91532024-11-02T04:09:35.470ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91542024-11-02T04:09:35.474ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a lock = UpdaterLock { updater_id: 91f58c04-da12-427f-98b6-be01743c0648, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-02T04:09:35.244658084Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91552024-11-02T04:09:35.474ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = CommitInstanceUpdates
91562024-11-02T04:09:35.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = CommitInstanceUpdates
91572024-11-02T04:09:35.511ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a new_runtime = InstanceRuntimeState { time_updated: 2024-11-02T04:09:35.244658084Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91582024-11-02T04:09:35.511ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91592024-11-02T04:09:35.511ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91602024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
91612024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
91622024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91632024-11-02T04:09:35.511ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91642024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91652024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91662024-11-02T04:09:35.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91672024-11-02T04:09:35.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91682024-11-02T04:09:35.514ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91692024-11-02T04:09:35.514ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91702024-11-02T04:09:35.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91712024-11-02T04:09:35.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91722024-11-02T04:09:35.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91732024-11-02T04:09:35.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91742024-11-02T04:09:35.518ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91752024-11-02T04:09:35.518ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("70aeba8a-4066-4620-bb46-a15fa016442a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ae2b4e8c-8f07-47d2-b46e-f505dadf6695")}) node_id = 7 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91762024-11-02T04:09:35.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91772024-11-02T04:09:35.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91782024-11-02T04:09:35.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91792024-11-02T04:09:35.521ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91802024-11-02T04:09:35.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91812024-11-02T04:09:35.524ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91822024-11-02T04:09:35.524ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91832024-11-02T04:09:35.528ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91842024-11-02T04:09:35.528ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91852024-11-02T04:09:35.533ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91862024-11-02T04:09:35.533ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ReleaseSledResources
91872024-11-02T04:09:35.533ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ReleaseSledResources
91882024-11-02T04:09:35.546ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91892024-11-02T04:09:35.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91902024-11-02T04:09:35.551ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91912024-11-02T04:09:35.551ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91922024-11-02T04:09:35.554ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a propolis_id = ae2b4e8c-8f07-47d2-b46e-f505dadf6695 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
91932024-11-02T04:09:35.554ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = MarkVmmDeleted
91942024-11-02T04:09:35.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = MarkVmmDeleted
91952024-11-02T04:09:35.564ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91962024-11-02T04:09:35.564ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91972024-11-02T04:09:35.568ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
91982024-11-02T04:09:35.568ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
91992024-11-02T04:09:35.571ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92002024-11-02T04:09:35.571ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92012024-11-02T04:09:35.574ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92022024-11-02T04:09:35.574ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92032024-11-02T04:09:35.578ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92042024-11-02T04:09:35.578ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92052024-11-02T04:09:35.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92062024-11-02T04:09:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92072024-11-02T04:09:35.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92082024-11-02T04:09:35.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92092024-11-02T04:09:35.583ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92102024-11-02T04:09:35.583ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92112024-11-02T04:09:35.612ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92122024-11-02T04:09:35.612ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92132024-11-02T04:09:35.612ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9d4e9cf-b324-456a-b83f-fd14dccd5d97", "content-length": "372", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
92142024-11-02T04:09:35.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92152024-11-02T04:09:35.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92162024-11-02T04:09:35.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = ea21ec94-d585-4b1a-a304-94820d0559f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
92172024-11-02T04:09:35.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = ea21ec94-d585-4b1a-a304-94820d0559f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
92182024-11-02T04:09:35.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = ea21ec94-d585-4b1a-a304-94820d0559f7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
92192024-11-02T04:09:35.626ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
92202024-11-02T04:09:35.626ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92212024-11-02T04:09:35.626ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a4ad74f0-188b-48f2-ab1f-a7ece06e60cd", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
92222024-11-02T04:09:35.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92232024-11-02T04:09:35.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92242024-11-02T04:09:35.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92252024-11-02T04:09:35.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92262024-11-02T04:09:35.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92272024-11-02T04:09:35.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92282024-11-02T04:09:35.635ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92292024-11-02T04:09:35.635ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92302024-11-02T04:09:35.635ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "264caae2-898b-46c1-aa24-6ed48a3b7570", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
92312024-11-02T04:09:35.636ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 125.218779ms iteration = 27 status = {}
92322024-11-02T04:09:35.639ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92332024-11-02T04:09:35.642ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 73ce13ac-7ea3-466e-9d78-11e4419419eb, lookup_type: ById(73ce13ac-7ea3-466e-9d78-11e4419419eb) }, key: 453d9a68-e399-48d9-9ee3-b25d4e917610, lookup_type: ById(453d9a68-e399-48d9-9ee3-b25d4e917610) }, key: 70aeba8a-4066-4620-bb46-a15fa016442a, lookup_type: ById(70aeba8a-4066-4620-bb46-a15fa016442a) } result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92342024-11-02T04:09:35.642ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92352024-11-02T04:09:35.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_node = ChainSuccessorSaga
92362024-11-02T04:09:35.650ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a karmic_state = WillReincarnate needs_reincarnation = false saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update
92372024-11-02T04:09:35.650ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92382024-11-02T04:09:35.650ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92392024-11-02T04:09:35.654ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92402024-11-02T04:09:35.654ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92412024-11-02T04:09:35.657ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92422024-11-02T04:09:35.657ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92432024-11-02T04:09:35.660ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92442024-11-02T04:09:35.660ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6
92452024-11-02T04:09:35.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92462024-11-02T04:09:35.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92472024-11-02T04:09:35.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92482024-11-02T04:09:35.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92492024-11-02T04:09:35.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92502024-11-02T04:09:35.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92512024-11-02T04:09:35.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522024-11-02T04:09:35.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92532024-11-02T04:09:35.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92542024-11-02T04:09:35.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92552024-11-02T04:09:35.704ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92562024-11-02T04:09:35.704ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 saga_name = instance-update saga_result = SagaResult { saga_id: 49136644-6efe-4d54-9424-8d1594dafdf6, saga_log: SagaLog { saga_id: 49136644-6efe-4d54-9424-8d1594dafdf6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("91f58c04-da12-427f-98b6-be01743c0648")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("91f58c04-da12-427f-98b6-be01743c0648")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("70aeba8a-4066-4620-bb46-a15fa016442a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ae2b4e8c-8f07-47d2-b46e-f505dadf6695")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("70aeba8a-4066-4620-bb46-a15fa016442a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ae2b4e8c-8f07-47d2-b46e-f505dadf6695")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("91f58c04-da12-427f-98b6-be01743c0648"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("91f58c04-da12-427f-98b6-be01743c0648")}} }) }
92572024-11-02T04:09:35.704ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 49136644-6efe-4d54-9424-8d1594dafdf6 instance_id = 70aeba8a-4066-4620-bb46-a15fa016442a saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update
92582024-11-02T04:09:35.704ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92592024-11-02T04:09:35.704ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
92602024-11-02T04:09:35.707ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92612024-11-02T04:09:35.707ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
92622024-11-02T04:09:35.711ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92632024-11-02T04:09:35.711ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
92642024-11-02T04:09:35.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92652024-11-02T04:09:35.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfc3e16f-b076-4e4a-8fee-6a6399d54896", "content-length": "691", "date": "Sat, 02 Nov 2024 04:09:35 GMT"} })
92662024-11-02T04:09:35.713ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92672024-11-02T04:09:35.713ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92682024-11-02T04:09:35.713ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
92692024-11-02T04:09:35.714ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92702024-11-02T04:09:35.714ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c
92712024-11-02T04:09:35.715ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 203.544761ms iteration = 26 status = {}
92722024-11-02T04:09:35.747ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update sec_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92732024-11-02T04:09:35.747ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e67a727b-a9c4-4c4b-9990-8f2e7f94656c saga_name = start-instance-update saga_result = SagaResult { saga_id: e67a727b-a9c4-4c4b-9990-8f2e7f94656c, saga_log: SagaLog { saga_id: e67a727b-a9c4-4c4b-9990-8f2e7f94656c, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("8e098265-a949-4d81-92c6-8a115bdfd37b")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8e098265-a949-4d81-92c6-8a115bdfd37b")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("8e098265-a949-4d81-92c6-8a115bdfd37b"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("8e098265-a949-4d81-92c6-8a115bdfd37b")}} }) }
92742024-11-02T04:09:35.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7826c4c0-7f86-490a-be57-9c14a924d213 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92752024-11-02T04:09:35.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7826c4c0-7f86-490a-be57-9c14a924d213 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92762024-11-02T04:09:35.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7826c4c0-7f86-490a-be57-9c14a924d213 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92772024-11-02T04:09:36.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 352cf02a-a835-42ae-9cbf-27b36bba66c9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92782024-11-02T04:09:36.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 352cf02a-a835-42ae-9cbf-27b36bba66c9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92792024-11-02T04:09:36.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 352cf02a-a835-42ae-9cbf-27b36bba66c9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92802024-11-02T04:09:37.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = bb4d9e85-0a71-48f0-8e40-294f1bf756dd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
92812024-11-02T04:09:37.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = bb4d9e85-0a71-48f0-8e40-294f1bf756dd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
92822024-11-02T04:09:37.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = bb4d9e85-0a71-48f0-8e40-294f1bf756dd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
92832024-11-02T04:09:37.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b23d8a3-b4b0-4231-a295-0af2f765b283 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92842024-11-02T04:09:37.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b23d8a3-b4b0-4231-a295-0af2f765b283 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92852024-11-02T04:09:37.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b23d8a3-b4b0-4231-a295-0af2f765b283 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92862024-11-02T04:09:38.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b16d03cc-e0e2-48e9-847f-b6122b3ee228 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92872024-11-02T04:09:38.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b16d03cc-e0e2-48e9-847f-b6122b3ee228 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92882024-11-02T04:09:38.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b16d03cc-e0e2-48e9-847f-b6122b3ee228 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92892024-11-02T04:09:38.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1417 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 971d1900-3648-4fb6-87ea-b1c1a99a9059 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
92902024-11-02T04:09:39.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b205c5d-31b0-461a-8213-453c7ad69c70 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92912024-11-02T04:09:39.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b205c5d-31b0-461a-8213-453c7ad69c70 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92922024-11-02T04:09:39.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b205c5d-31b0-461a-8213-453c7ad69c70 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92932024-11-02T04:09:40.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a2d3b35-a16a-4b51-948f-494cf412611d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92942024-11-02T04:09:40.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a2d3b35-a16a-4b51-948f-494cf412611d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92952024-11-02T04:09:40.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a2d3b35-a16a-4b51-948f-494cf412611d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92962024-11-02T04:09:41.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 527401b7-1904-45dc-ba42-d4284387b101 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92972024-11-02T04:09:41.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 527401b7-1904-45dc-ba42-d4284387b101 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92982024-11-02T04:09:41.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 527401b7-1904-45dc-ba42-d4284387b101 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
92992024-11-02T04:09:42.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40471f60-7368-44b8-9d51-ffe07f0ca3fd roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
93002024-11-02T04:09:42.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40471f60-7368-44b8-9d51-ffe07f0ca3fd resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
93012024-11-02T04:09:42.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40471f60-7368-44b8-9d51-ffe07f0ca3fd response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
93022024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
93032024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
93042024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93052024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93062024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
93072024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93082024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
93092024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93102024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
93112024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
93122024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93132024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
93142024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93152024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93162024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93172024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
93182024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
93192024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93202024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93212024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
93222024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93232024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
93242024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
93252024-11-02T04:09:43.543ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93262024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93272024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
93282024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93292024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93302024-11-02T04:09:43.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93312024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93322024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93332024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93342024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93352024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93362024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93372024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93382024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93392024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93402024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93412024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
93422024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
93432024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.37\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
93442024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
93452024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.23\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
93462024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
93472024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.45\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93482024-11-02T04:09:43.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.9\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93492024-11-02T04:09:43.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93502024-11-02T04:09:43.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93512024-11-02T04:09:43.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10087, tv_nsec: 521344249 } })
93522024-11-02T04:09:43.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93532024-11-02T04:09:43.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
93542024-11-02T04:09:43.547ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.681349ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93552024-11-02T04:09:43.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-11-02T04:09:43.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10087, tv_nsec: 522888062 } })
93572024-11-02T04:09:43.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93582024-11-02T04:09:43.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
93592024-11-02T04:09:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93602024-11-02T04:09:43.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93612024-11-02T04:09:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93622024-11-02T04:09:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93632024-11-02T04:09:43.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93642024-11-02T04:09:43.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93652024-11-02T04:09:43.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93662024-11-02T04:09:43.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93672024-11-02T04:09:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93682024-11-02T04:09:43.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93692024-11-02T04:09:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93702024-11-02T04:09:43.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93712024-11-02T04:09:43.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93722024-11-02T04:09:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93732024-11-02T04:09:43.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93742024-11-02T04:09:43.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93752024-11-02T04:09:43.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93762024-11-02T04:09:43.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10087, tv_nsec: 533280625 } })
93772024-11-02T04:09:43.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.411961ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93782024-11-02T04:09:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93792024-11-02T04:09:43.559ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
93802024-11-02T04:09:43.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93812024-11-02T04:09:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93822024-11-02T04:09:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93832024-11-02T04:09:43.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93842024-11-02T04:09:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93852024-11-02T04:09:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93862024-11-02T04:09:43.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93872024-11-02T04:09:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93882024-11-02T04:09:43.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93892024-11-02T04:09:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93902024-11-02T04:09:43.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
93912024-11-02T04:09:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93922024-11-02T04:09:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93932024-11-02T04:09:43.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
93942024-11-02T04:09:43.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.790066ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
93952024-11-02T04:09:43.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93962024-11-02T04:09:43.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93972024-11-02T04:09:43.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93982024-11-02T04:09:43.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93992024-11-02T04:09:43.586ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94002024-11-02T04:09:43.586ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94012024-11-02T04:09:43.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94022024-11-02T04:09:43.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94032024-11-02T04:09:43.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94042024-11-02T04:09:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94052024-11-02T04:09:43.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94062024-11-02T04:09:43.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94072024-11-02T04:09:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94082024-11-02T04:09:43.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94092024-11-02T04:09:43.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102024-11-02T04:09:43.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94112024-11-02T04:09:43.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94122024-11-02T04:09:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
94132024-11-02T04:09:43.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94142024-11-02T04:09:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94152024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94162024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94172024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94182024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94192024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94202024-11-02T04:09:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94212024-11-02T04:09:43.600ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.187018ms iteration = 26 status = 0
94222024-11-02T04:09:43.610ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94232024-11-02T04:09:43.610ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.56956ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94242024-11-02T04:09:43.620ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94252024-11-02T04:09:43.620ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94262024-11-02T04:09:43.620ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.215289ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94272024-11-02T04:09:43.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94282024-11-02T04:09:43.622ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94292024-11-02T04:09:43.622ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a8cce01-a97b-48c9-9740-46e6ee75cec8", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94302024-11-02T04:09:43.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94312024-11-02T04:09:43.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94322024-11-02T04:09:43.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94332024-11-02T04:09:43.633ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94342024-11-02T04:09:43.633ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8841841a-65e9-4574-b6e8-6460d93ee142", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94352024-11-02T04:09:43.633ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94362024-11-02T04:09:43.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.398861ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94372024-11-02T04:09:43.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94382024-11-02T04:09:43.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
94392024-11-02T04:09:43.638ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94402024-11-02T04:09:43.638ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07c74204-b153-4cf1-932b-60dff031d569", "content-length": "26", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94412024-11-02T04:09:43.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94422024-11-02T04:09:43.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
94432024-11-02T04:09:43.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.865496ms iteration = 30 status = {"physical_disks_added":0}
94442024-11-02T04:09:43.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94452024-11-02T04:09:43.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94462024-11-02T04:09:43.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94472024-11-02T04:09:43.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94482024-11-02T04:09:43.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94492024-11-02T04:09:43.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94502024-11-02T04:09:43.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94512024-11-02T04:09:43.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94522024-11-02T04:09:43.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94532024-11-02T04:09:43.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94542024-11-02T04:09:43.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94552024-11-02T04:09:43.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94562024-11-02T04:09:43.731ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94572024-11-02T04:09:43.732ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "279eff9d-886c-4538-b441-5caed49a3282", "content-length": "2", "date": "Sat, 02 Nov 2024 04:09:42 GMT"} })
94582024-11-02T04:09:43.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94592024-11-02T04:09:43.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94602024-11-02T04:09:43.791ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94612024-11-02T04:09:43.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94622024-11-02T04:09:43.793ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.411707ms iteration = 26 status = null
94632024-11-02T04:09:43.825ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94642024-11-02T04:09:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.449504ms iteration = 26 status = {}
94652024-11-02T04:09:43.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c32e267-ebea-49a7-aa1d-22ab0d178a30", "content-length": "691", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94662024-11-02T04:09:43.870ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94672024-11-02T04:09:43.870ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94682024-11-02T04:09:43.870ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94692024-11-02T04:09:43.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afec74b7-4aa3-4d07-b9b3-e83fc2e49089", "content-length": "372", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94702024-11-02T04:09:43.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94712024-11-02T04:09:43.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94722024-11-02T04:09:43.872ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 328.402082ms iteration = 27 status = {}
94732024-11-02T04:09:43.885ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
94742024-11-02T04:09:43.885ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94752024-11-02T04:09:43.886ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "63742076-8344-4489-a5d6-5993a6d70f4d", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94762024-11-02T04:09:43.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94772024-11-02T04:09:43.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94782024-11-02T04:09:43.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94792024-11-02T04:09:43.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94802024-11-02T04:09:43.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94812024-11-02T04:09:43.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94822024-11-02T04:09:43.893ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94832024-11-02T04:09:43.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94842024-11-02T04:09:43.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16c0351e-105b-4c12-99f3-2cdfb7d7f13a", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
94852024-11-02T04:09:43.896ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 352.529271ms iteration = 28 status = {}
94862024-11-02T04:09:43.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94872024-11-02T04:09:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94882024-11-02T04:09:43.905ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
94892024-11-02T04:09:43.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94902024-11-02T04:09:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94912024-11-02T04:09:43.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = da35bd8f-dc9c-407d-8e25-50ac3e359bc5 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
94922024-11-02T04:09:43.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = da35bd8f-dc9c-407d-8e25-50ac3e359bc5 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
94932024-11-02T04:09:43.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = da35bd8f-dc9c-407d-8e25-50ac3e359bc5 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
94942024-11-02T04:09:43.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 334e2976-5f1c-4631-9641-91a0d0fa845d roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
94952024-11-02T04:09:43.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 334e2976-5f1c-4631-9641-91a0d0fa845d resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
94962024-11-02T04:09:43.915ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94972024-11-02T04:09:43.915ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a11f00c-0ec8-427a-95de-1b209a9a8d8f", "content-length": "134", "date": "Sat, 02 Nov 2024 04:09:42 GMT"} })
94982024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94992024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
95002024-11-02T04:09:43.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64312 req_id = 334e2976-5f1c-4631-9641-91a0d0fa845d response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
95012024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95022024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95032024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95042024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95052024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95062024-11-02T04:09:43.915ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95072024-11-02T04:09:43.916ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95082024-11-02T04:09:43.916ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95092024-11-02T04:09:43.916ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
95102024-11-02T04:09:43.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95112024-11-02T04:09:43.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95122024-11-02T04:09:43.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95132024-11-02T04:09:43.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b0c1e0-25fa-477d-b9cb-2df57c385d1b", "content-length": "2", "date": "Sat, 02 Nov 2024 04:09:42 GMT"} })
95142024-11-02T04:09:43.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95152024-11-02T04:09:43.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a288672b-e92a-450a-ad94-85bd494f1f65", "content-length": "52", "date": "Sat, 02 Nov 2024 04:09:42 GMT"} })
95162024-11-02T04:09:43.918ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
95172024-11-02T04:09:43.918ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95182024-11-02T04:09:44.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "62361977-258e-4da9-9c8d-6448d87854e2", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
95192024-11-02T04:09:44.024ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
95202024-11-02T04:09:44.024ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95212024-11-02T04:09:44.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94546f3b-7601-4e76-883f-d38bbe26d03e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95222024-11-02T04:09:44.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94546f3b-7601-4e76-883f-d38bbe26d03e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95232024-11-02T04:09:44.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64824d6c-48f4-480f-a105-39563419828f", "content-length": "682", "date": "Sat, 02 Nov 2024 04:09:43 GMT"} })
95242024-11-02T04:09:44.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95252024-11-02T04:09:44.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95262024-11-02T04:09:44.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94546f3b-7601-4e76-883f-d38bbe26d03e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95272024-11-02T04:09:44.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95282024-11-02T04:09:44.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95292024-11-02T04:09:44.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95302024-11-02T04:09:44.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95312024-11-02T04:09:44.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95322024-11-02T04:09:44.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95332024-11-02T04:09:44.046ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.453581ms iteration = 26 status = {}
95342024-11-02T04:09:45.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40d07b62-45a4-4127-bf64-7cab369a6a63 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95352024-11-02T04:09:45.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40d07b62-45a4-4127-bf64-7cab369a6a63 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95362024-11-02T04:09:45.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 40d07b62-45a4-4127-bf64-7cab369a6a63 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95372024-11-02T04:09:46.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e12fed5-0d92-44b3-9f99-91e097fc5ed7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95382024-11-02T04:09:46.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e12fed5-0d92-44b3-9f99-91e097fc5ed7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95392024-11-02T04:09:46.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0e12fed5-0d92-44b3-9f99-91e097fc5ed7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95402024-11-02T04:09:47.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6ca04d9d-06d3-4b39-adee-4c4436fd7bf9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95412024-11-02T04:09:47.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6ca04d9d-06d3-4b39-adee-4c4436fd7bf9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95422024-11-02T04:09:47.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6ca04d9d-06d3-4b39-adee-4c4436fd7bf9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95432024-11-02T04:09:48.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 519eab6c-dfd0-465f-a3ca-3cbaa7dde62f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95442024-11-02T04:09:48.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 519eab6c-dfd0-465f-a3ca-3cbaa7dde62f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95452024-11-02T04:09:48.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 519eab6c-dfd0-465f-a3ca-3cbaa7dde62f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95462024-11-02T04:09:49.037ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48177
95472024-11-02T04:09:49.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48177 req_id = 3bf3a020-9438-4603-88b2-5c74254e4821 roles = RoleSet { roles: {} } uri = /metrics/producers
95482024-11-02T04:09:49.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48177 req_id = 3bf3a020-9438-4603-88b2-5c74254e4821 resource = Database result = Ok(()) uri = /metrics/producers
95492024-11-02T04:09:49.079ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 6b8d67f3-a714-4683-8553-09335a4a9d26
95502024-11-02T04:09:49.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42163 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48177 req_id = 3bf3a020-9438-4603-88b2-5c74254e4821 response_code = 201 uri = /metrics/producers
95512024-11-02T04:09:49.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 153aba8f-02f9-4c70-b95d-994921c70178 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95522024-11-02T04:09:49.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 153aba8f-02f9-4c70-b95d-994921c70178 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95532024-11-02T04:09:49.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 153aba8f-02f9-4c70-b95d-994921c70178 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95542024-11-02T04:09:50.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94e03e6f-5c7e-48d2-a6a5-ce09a8122f6e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95552024-11-02T04:09:50.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94e03e6f-5c7e-48d2-a6a5-ce09a8122f6e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95562024-11-02T04:09:50.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 94e03e6f-5c7e-48d2-a6a5-ce09a8122f6e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95572024-11-02T04:09:50.708ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56782
95582024-11-02T04:09:50.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56782 req_id = 897667dc-22c1-4452-95bb-7e0277245948 roles = RoleSet { roles: {} } uri = /metrics/producers
95592024-11-02T04:09:50.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56782 req_id = 897667dc-22c1-4452-95bb-7e0277245948 resource = Database result = Ok(()) uri = /metrics/producers
95602024-11-02T04:09:50.745ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = bbe1fec9-a47f-440b-bc9d-2726d77e81dc
95612024-11-02T04:09:50.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36162 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56782 req_id = 897667dc-22c1-4452-95bb-7e0277245948 response_code = 201 uri = /metrics/producers
95622024-11-02T04:09:51.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4748a2e6-9811-46bb-b34c-596b67a8f54a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95632024-11-02T04:09:51.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4748a2e6-9811-46bb-b34c-596b67a8f54a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95642024-11-02T04:09:51.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4748a2e6-9811-46bb-b34c-596b67a8f54a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95652024-11-02T04:09:52.011ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35420
95662024-11-02T04:09:52.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35420 req_id = 18ad1972-2e1b-4f54-9e35-b5062269f6a8 roles = RoleSet { roles: {} } uri = /metrics/producers
95672024-11-02T04:09:52.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35420 req_id = 18ad1972-2e1b-4f54-9e35-b5062269f6a8 resource = Database result = Ok(()) uri = /metrics/producers
95682024-11-02T04:09:52.020ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d565c44-21ca-41c0-b1d4-bcace41c9902
95692024-11-02T04:09:52.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9062 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35420 req_id = 18ad1972-2e1b-4f54-9e35-b5062269f6a8 response_code = 201 uri = /metrics/producers
95702024-11-02T04:09:52.135ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54172
95712024-11-02T04:09:52.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54172 req_id = e19b8cd1-153e-4b2a-86ca-b5d57bf887c5 roles = RoleSet { roles: {} } uri = /metrics/producers
95722024-11-02T04:09:52.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54172 req_id = e19b8cd1-153e-4b2a-86ca-b5d57bf887c5 resource = Database result = Ok(()) uri = /metrics/producers
95732024-11-02T04:09:52.168ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = df01f79b-0682-4f1b-aa97-1a8bb18b9157
95742024-11-02T04:09:52.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33588 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54172 req_id = e19b8cd1-153e-4b2a-86ca-b5d57bf887c5 response_code = 201 uri = /metrics/producers
95752024-11-02T04:09:52.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 325ca56a-5fce-41e9-b224-388b4585b788 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95762024-11-02T04:09:52.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 325ca56a-5fce-41e9-b224-388b4585b788 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95772024-11-02T04:09:52.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 325ca56a-5fce-41e9-b224-388b4585b788 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95782024-11-02T04:09:52.353ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36366
95792024-11-02T04:09:52.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36366 req_id = 7bd80961-fd65-4720-b0ee-b357843beea5 roles = RoleSet { roles: {} } uri = /metrics/producers
95802024-11-02T04:09:52.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36366 req_id = 7bd80961-fd65-4720-b0ee-b357843beea5 resource = Database result = Ok(()) uri = /metrics/producers
95812024-11-02T04:09:52.362ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 84e94f83-f18a-4122-a272-bfe20f1486da
95822024-11-02T04:09:52.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9674 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36366 req_id = 7bd80961-fd65-4720-b0ee-b357843beea5 response_code = 201 uri = /metrics/producers
95832024-11-02T04:09:53.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9a0b4c6-85d7-4a54-8ae6-800cdd6c452e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95842024-11-02T04:09:53.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9a0b4c6-85d7-4a54-8ae6-800cdd6c452e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95852024-11-02T04:09:53.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f9a0b4c6-85d7-4a54-8ae6-800cdd6c452e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
95862024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
95872024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95882024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
95892024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95902024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95912024-11-02T04:09:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95922024-11-02T04:09:53.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95932024-11-02T04:09:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95942024-11-02T04:09:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95952024-11-02T04:09:53.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.16275ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95962024-11-02T04:09:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95972024-11-02T04:09:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95982024-11-02T04:09:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95992024-11-02T04:09:53.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96002024-11-02T04:09:53.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96012024-11-02T04:09:53.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96022024-11-02T04:09:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
96032024-11-02T04:09:53.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96042024-11-02T04:09:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96052024-11-02T04:09:53.565ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
96062024-11-02T04:09:53.565ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.805019ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
96072024-11-02T04:09:53.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1405 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = e04183b0-9350-4614-92c6-b0d38c3e3db2 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
96082024-11-02T04:09:54.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03cfb277-9c9c-4212-90f1-f498836f8438 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96092024-11-02T04:09:54.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03cfb277-9c9c-4212-90f1-f498836f8438 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96102024-11-02T04:09:54.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03cfb277-9c9c-4212-90f1-f498836f8438 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96112024-11-02T04:09:55.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65d227b8-545d-4e87-83d5-90fa5f39b89d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96122024-11-02T04:09:55.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65d227b8-545d-4e87-83d5-90fa5f39b89d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96132024-11-02T04:09:55.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65d227b8-545d-4e87-83d5-90fa5f39b89d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96142024-11-02T04:09:56.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 930de0fe-961d-4427-9705-f2cdeeebecf1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96152024-11-02T04:09:56.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 930de0fe-961d-4427-9705-f2cdeeebecf1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96162024-11-02T04:09:56.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 930de0fe-961d-4427-9705-f2cdeeebecf1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96172024-11-02T04:09:57.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f95b03e-bbd9-4c54-b3a7-d646acb65428 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96182024-11-02T04:09:57.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f95b03e-bbd9-4c54-b3a7-d646acb65428 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96192024-11-02T04:09:57.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f95b03e-bbd9-4c54-b3a7-d646acb65428 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96202024-11-02T04:09:58.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 02424418-2a61-4f2c-aa62-c4213c480779 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96212024-11-02T04:09:58.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 02424418-2a61-4f2c-aa62-c4213c480779 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96222024-11-02T04:09:58.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 02424418-2a61-4f2c-aa62-c4213c480779 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96232024-11-02T04:09:59.336ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:36780
96242024-11-02T04:09:59.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36780 req_id = 594249a2-afef-40b0-8a6c-9f52635d44b8 roles = RoleSet { roles: {} } uri = /metrics/producers
96252024-11-02T04:09:59.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36780 req_id = 594249a2-afef-40b0-8a6c-9f52635d44b8 resource = Database result = Ok(()) uri = /metrics/producers
96262024-11-02T04:09:59.343ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 5b8cdd5a-f021-45f2-8323-b6c8f9776060
96272024-11-02T04:09:59.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7673 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36780 req_id = 594249a2-afef-40b0-8a6c-9f52635d44b8 response_code = 201 uri = /metrics/producers
96282024-11-02T04:09:59.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f91838fa-5ef9-4f3b-9d20-d196c7b9c7ab roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96292024-11-02T04:09:59.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f91838fa-5ef9-4f3b-9d20-d196c7b9c7ab resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96302024-11-02T04:09:59.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f91838fa-5ef9-4f3b-9d20-d196c7b9c7ab response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96312024-11-02T04:10:00.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 424fa5d5-233b-4c8a-a9c1-6196fd2b8354 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96322024-11-02T04:10:00.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 424fa5d5-233b-4c8a-a9c1-6196fd2b8354 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96332024-11-02T04:10:00.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 424fa5d5-233b-4c8a-a9c1-6196fd2b8354 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96342024-11-02T04:10:01.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dcb8b5e-4d01-43e2-9562-5ca2134b5ce2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96352024-11-02T04:10:01.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dcb8b5e-4d01-43e2-9562-5ca2134b5ce2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96362024-11-02T04:10:01.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8dcb8b5e-4d01-43e2-9562-5ca2134b5ce2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96372024-11-02T04:10:02.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5f9db20a-f732-472f-a72e-5f4107fe2f8b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96382024-11-02T04:10:02.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5f9db20a-f732-472f-a72e-5f4107fe2f8b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96392024-11-02T04:10:02.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5f9db20a-f732-472f-a72e-5f4107fe2f8b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96402024-11-02T04:10:03.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 968c0586-9182-4e92-8c44-5f5a184d2a8a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96412024-11-02T04:10:03.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 968c0586-9182-4e92-8c44-5f5a184d2a8a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96422024-11-02T04:10:03.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 968c0586-9182-4e92-8c44-5f5a184d2a8a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96432024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
96442024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
96452024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96462024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96472024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96482024-11-02T04:10:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96492024-11-02T04:10:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96502024-11-02T04:10:03.547ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96512024-11-02T04:10:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96522024-11-02T04:10:03.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.20277ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96532024-11-02T04:10:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96542024-11-02T04:10:03.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96552024-11-02T04:10:03.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96562024-11-02T04:10:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96572024-11-02T04:10:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96582024-11-02T04:10:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96592024-11-02T04:10:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
96602024-11-02T04:10:03.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96612024-11-02T04:10:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96622024-11-02T04:10:03.565ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
96632024-11-02T04:10:03.565ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.064423ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
96642024-11-02T04:10:04.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd736b36-f913-4808-b1b3-48482996881f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96652024-11-02T04:10:04.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd736b36-f913-4808-b1b3-48482996881f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96662024-11-02T04:10:04.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd736b36-f913-4808-b1b3-48482996881f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96672024-11-02T04:10:05.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e0935d2-89f2-4941-8e56-ddaf73ad4ca7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96682024-11-02T04:10:05.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e0935d2-89f2-4941-8e56-ddaf73ad4ca7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96692024-11-02T04:10:05.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3e0935d2-89f2-4941-8e56-ddaf73ad4ca7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96702024-11-02T04:10:06.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb04e10d-720c-4dc7-bd37-819247fd0156 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96712024-11-02T04:10:06.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb04e10d-720c-4dc7-bd37-819247fd0156 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96722024-11-02T04:10:06.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb04e10d-720c-4dc7-bd37-819247fd0156 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96732024-11-02T04:10:07.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d379d1c-7da7-4cd1-a9fc-44db58ea90aa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96742024-11-02T04:10:07.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d379d1c-7da7-4cd1-a9fc-44db58ea90aa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96752024-11-02T04:10:07.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2d379d1c-7da7-4cd1-a9fc-44db58ea90aa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96762024-11-02T04:10:07.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 2053f8ed-1d41-4d45-8f1a-57cc962f4eb5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
96772024-11-02T04:10:07.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 2053f8ed-1d41-4d45-8f1a-57cc962f4eb5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
96782024-11-02T04:10:07.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 2053f8ed-1d41-4d45-8f1a-57cc962f4eb5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
96792024-11-02T04:10:08.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 82cda6cb-68a8-41d9-93b2-d99df9661ca5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96802024-11-02T04:10:08.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 82cda6cb-68a8-41d9-93b2-d99df9661ca5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96812024-11-02T04:10:08.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 82cda6cb-68a8-41d9-93b2-d99df9661ca5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96822024-11-02T04:10:08.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 33bff152-0223-44c5-8002-226e9235dd73 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
96832024-11-02T04:10:09.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd4954a1-abc2-4594-aa2e-0877ea28be5f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96842024-11-02T04:10:09.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd4954a1-abc2-4594-aa2e-0877ea28be5f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96852024-11-02T04:10:09.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = dd4954a1-abc2-4594-aa2e-0877ea28be5f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96862024-11-02T04:10:10.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 348675aa-ef11-41f0-a031-73ba996136ec roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96872024-11-02T04:10:10.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 348675aa-ef11-41f0-a031-73ba996136ec resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96882024-11-02T04:10:10.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 348675aa-ef11-41f0-a031-73ba996136ec response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96892024-11-02T04:10:11.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffda0def-07c6-431e-be47-0111f030a0cb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96902024-11-02T04:10:11.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffda0def-07c6-431e-be47-0111f030a0cb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96912024-11-02T04:10:11.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ffda0def-07c6-431e-be47-0111f030a0cb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96922024-11-02T04:10:12.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5da4d1e-7670-46b2-8668-14d07baea5d4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96932024-11-02T04:10:12.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5da4d1e-7670-46b2-8668-14d07baea5d4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96942024-11-02T04:10:12.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f5da4d1e-7670-46b2-8668-14d07baea5d4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
96952024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
96962024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
96972024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
96982024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
96992024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97002024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97012024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
97022024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
97032024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97042024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
97052024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97062024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97072024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
97082024-11-02T04:10:13.544ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
97092024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
97102024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.05\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
97112024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97122024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
97132024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
97142024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97152024-11-02T04:10:13.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97162024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
97172024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97182024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97192024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
97202024-11-02T04:10:13.544ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 04:00:13.544485275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
97212024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
97222024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
97232024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97242024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
97252024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97262024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
97272024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
97282024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
97292024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97302024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
97312024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
97322024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97332024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
97342024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
97352024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
97362024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
97372024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97382024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
97392024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97402024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97412024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97422024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
97432024-11-02T04:10:13.544ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
97442024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97452024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
97462024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
97472024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.271\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97482024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
97492024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
97502024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
97512024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.51\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
97522024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
97532024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
97542024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97552024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
97562024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.36\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97572024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97582024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97592024-11-02T04:10:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97602024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97612024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97622024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97632024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97642024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97652024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97662024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97672024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97682024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97692024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97702024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97712024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97722024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97732024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97742024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97752024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97762024-11-02T04:10:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 10117, tv_nsec: 519435168 } })
97772024-11-02T04:10:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 10117, tv_nsec: 519443768 } })
97782024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97792024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
97802024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.187436ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
97812024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
97822024-11-02T04:10:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.300688ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
97832024-11-02T04:10:13.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97842024-11-02T04:10:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97852024-11-02T04:10:13.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10117, tv_nsec: 522132616 } })
97862024-11-02T04:10:13.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
97872024-11-02T04:10:13.548ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.579997ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97882024-11-02T04:10:13.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97892024-11-02T04:10:13.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97902024-11-02T04:10:13.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912024-11-02T04:10:13.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97922024-11-02T04:10:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97932024-11-02T04:10:13.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942024-11-02T04:10:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97952024-11-02T04:10:13.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97962024-11-02T04:10:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97972024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97982024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97992024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98002024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98012024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98022024-11-02T04:10:13.552ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 04:00:13.544485275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
98032024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.251397ms iteration = 14 status = {"expiration":"2024-11-02T04:00:13.544485275Z","pruned":[]}
98042024-11-02T04:10:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98052024-11-02T04:10:13.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98062024-11-02T04:10:13.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98072024-11-02T04:10:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98082024-11-02T04:10:13.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98092024-11-02T04:10:13.554ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10117, tv_nsec: 529042784 } })
98102024-11-02T04:10:13.555ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
98112024-11-02T04:10:13.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98122024-11-02T04:10:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98132024-11-02T04:10:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98142024-11-02T04:10:13.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98152024-11-02T04:10:13.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98162024-11-02T04:10:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98172024-11-02T04:10:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98182024-11-02T04:10:13.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98192024-11-02T04:10:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98202024-11-02T04:10:13.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98212024-11-02T04:10:13.562ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98222024-11-02T04:10:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98232024-11-02T04:10:13.564ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.632422ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
98242024-11-02T04:10:13.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.294096ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98252024-11-02T04:10:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
98262024-11-02T04:10:13.565ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
98272024-11-02T04:10:13.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
98282024-11-02T04:10:13.566ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98292024-11-02T04:10:13.566ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98302024-11-02T04:10:13.566ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.601574ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98312024-11-02T04:10:13.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98322024-11-02T04:10:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98332024-11-02T04:10:13.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98342024-11-02T04:10:13.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98352024-11-02T04:10:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98362024-11-02T04:10:13.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98372024-11-02T04:10:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98382024-11-02T04:10:13.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98392024-11-02T04:10:13.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98402024-11-02T04:10:13.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98412024-11-02T04:10:13.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98422024-11-02T04:10:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98432024-11-02T04:10:13.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98442024-11-02T04:10:13.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98452024-11-02T04:10:13.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98462024-11-02T04:10:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98472024-11-02T04:10:13.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98482024-11-02T04:10:13.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98492024-11-02T04:10:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98502024-11-02T04:10:13.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98512024-11-02T04:10:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98522024-11-02T04:10:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98532024-11-02T04:10:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
98542024-11-02T04:10:13.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98552024-11-02T04:10:13.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98562024-11-02T04:10:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
98572024-11-02T04:10:13.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98582024-11-02T04:10:13.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98592024-11-02T04:10:13.599ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98602024-11-02T04:10:13.600ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98612024-11-02T04:10:13.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98622024-11-02T04:10:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98632024-11-02T04:10:13.606ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
98642024-11-02T04:10:13.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.278308ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
98652024-11-02T04:10:13.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98662024-11-02T04:10:13.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98672024-11-02T04:10:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98682024-11-02T04:10:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98692024-11-02T04:10:13.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98702024-11-02T04:10:13.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98712024-11-02T04:10:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98722024-11-02T04:10:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98732024-11-02T04:10:13.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98742024-11-02T04:10:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98752024-11-02T04:10:13.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10117, tv_nsec: 592947637 } })
98762024-11-02T04:10:13.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
98772024-11-02T04:10:13.621ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98782024-11-02T04:10:13.621ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.482172ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98792024-11-02T04:10:13.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98802024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98812024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98822024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98832024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98842024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98852024-11-02T04:10:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98862024-11-02T04:10:13.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98872024-11-02T04:10:13.630ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98882024-11-02T04:10:13.630ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98892024-11-02T04:10:13.630ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.158161ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98902024-11-02T04:10:13.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98912024-11-02T04:10:13.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98922024-11-02T04:10:13.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98932024-11-02T04:10:13.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98942024-11-02T04:10:13.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98952024-11-02T04:10:13.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98962024-11-02T04:10:13.638ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98972024-11-02T04:10:13.638ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98982024-11-02T04:10:13.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98992024-11-02T04:10:13.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99002024-11-02T04:10:13.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99012024-11-02T04:10:13.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99022024-11-02T04:10:13.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99032024-11-02T04:10:13.641ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99042024-11-02T04:10:13.641ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99052024-11-02T04:10:13.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.567294ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99062024-11-02T04:10:13.645ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.5678ms iteration = 31 status = {"physical_disks_added":0}
99072024-11-02T04:10:13.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99082024-11-02T04:10:13.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.912894ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99092024-11-02T04:10:13.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
99102024-11-02T04:10:13.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99112024-11-02T04:10:13.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99122024-11-02T04:10:13.653ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.184125ms iteration = 27 status = 0
99132024-11-02T04:10:13.655ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
99142024-11-02T04:10:13.655ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 110.724728ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99152024-11-02T04:10:13.666ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
99162024-11-02T04:10:13.666ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
99172024-11-02T04:10:13.666ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
99182024-11-02T04:10:13.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99192024-11-02T04:10:13.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99202024-11-02T04:10:13.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99212024-11-02T04:10:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99222024-11-02T04:10:13.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99232024-11-02T04:10:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99242024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
99252024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
99262024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99272024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99282024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
99292024-11-02T04:10:13.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99302024-11-02T04:10:13.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99312024-11-02T04:10:13.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99322024-11-02T04:10:13.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99332024-11-02T04:10:13.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99342024-11-02T04:10:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99352024-11-02T04:10:13.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99362024-11-02T04:10:13.680ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99372024-11-02T04:10:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99382024-11-02T04:10:13.680ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99392024-11-02T04:10:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99402024-11-02T04:10:13.680ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eebcbed1-f72c-46ce-a4b3-1b46fa4b2110", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
99412024-11-02T04:10:13.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99422024-11-02T04:10:13.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99432024-11-02T04:10:13.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99442024-11-02T04:10:13.682ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99452024-11-02T04:10:13.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 137.707368ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99462024-11-02T04:10:13.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99472024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99482024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99492024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
99502024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.534305ms iteration = 15 status = {"generation":1}
99512024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
99522024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
99532024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
99542024-11-02T04:10:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.522805ms iteration = 15 status = {"generation":2}
99552024-11-02T04:10:13.693ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99562024-11-02T04:10:13.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99572024-11-02T04:10:13.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99582024-11-02T04:10:13.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99592024-11-02T04:10:13.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99602024-11-02T04:10:13.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99612024-11-02T04:10:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99622024-11-02T04:10:13.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7db7416d-7363-4dc1-be36-ccdf8ab60601 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
99632024-11-02T04:10:13.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7db7416d-7363-4dc1-be36-ccdf8ab60601 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
99642024-11-02T04:10:13.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99652024-11-02T04:10:13.726ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99662024-11-02T04:10:13.726ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f88ef3a-dcca-484b-bd08-594cbf599804", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
99672024-11-02T04:10:13.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99682024-11-02T04:10:13.727ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99692024-11-02T04:10:13.741ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99702024-11-02T04:10:13.850ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99712024-11-02T04:10:13.850ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f880236-d556-46eb-b052-c500a1ad47bd", "content-length": "2", "date": "Sat, 02 Nov 2024 04:10:12 GMT"} })
99722024-11-02T04:10:13.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99732024-11-02T04:10:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99742024-11-02T04:10:13.874ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99752024-11-02T04:10:13.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99762024-11-02T04:10:13.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3325681-2f06-4197-9d21-1da1073ac759", "content-length": "372", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
99772024-11-02T04:10:13.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99782024-11-02T04:10:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99792024-11-02T04:10:13.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99802024-11-02T04:10:13.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7db7416d-7363-4dc1-be36-ccdf8ab60601 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
99812024-11-02T04:10:13.877ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 333.162865ms iteration = 27 status = null
99822024-11-02T04:10:13.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99832024-11-02T04:10:13.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99842024-11-02T04:10:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99852024-11-02T04:10:13.889ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99862024-11-02T04:10:13.889ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99872024-11-02T04:10:13.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7041783c-11d4-49a6-8dbb-b723cba2ac87", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
99882024-11-02T04:10:13.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99892024-11-02T04:10:13.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99902024-11-02T04:10:13.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99912024-11-02T04:10:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99922024-11-02T04:10:13.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99932024-11-02T04:10:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99942024-11-02T04:10:13.897ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99952024-11-02T04:10:13.897ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99962024-11-02T04:10:13.897ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f060ef25-ab89-49cb-9585-88e3b5a3ba18", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
99972024-11-02T04:10:13.899ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 355.105847ms iteration = 29 status = {}
99982024-11-02T04:10:13.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
99992024-11-02T04:10:13.950ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100002024-11-02T04:10:13.950ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fe83cb3-c7f7-40dc-8f86-4412e6b6ab39", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
100012024-11-02T04:10:13.950ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100022024-11-02T04:10:13.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
100032024-11-02T04:10:13.991ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
100042024-11-02T04:10:14.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
100052024-11-02T04:10:14.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f080c246-47ad-4ddb-912b-478e85b1894b", "date": "Sat, 02 Nov 2024 04:10:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100062024-11-02T04:10:14.001ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100072024-11-02T04:10:14.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "699aa07f-e900-44d4-a1e5-8fdb682749e8", "date": "Sat, 02 Nov 2024 04:10:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100082024-11-02T04:10:14.003ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100092024-11-02T04:10:14.005ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100102024-11-02T04:10:14.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 461.575623ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
100112024-11-02T04:10:14.011ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 467.546101ms iteration = 27 status = {}
100122024-11-02T04:10:14.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100132024-11-02T04:10:14.063ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
100142024-11-02T04:10:14.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a806049b-0446-4f01-929d-ddc704cdab08", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100152024-11-02T04:10:14.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100162024-11-02T04:10:14.066ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "13e17824-2b18-4004-bfe0-ba7c6defaf6d", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100172024-11-02T04:10:14.066ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100182024-11-02T04:10:14.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "52475905-844c-4de8-8f8f-076e677742e2", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100192024-11-02T04:10:14.067ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100202024-11-02T04:10:14.069ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
100212024-11-02T04:10:14.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.111847ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
100222024-11-02T04:10:14.097ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "42e3e10a-309a-4702-9f45-b3641d4c33bc", "content-length": "691", "date": "Sat, 02 Nov 2024 04:10:14 GMT"} })
100232024-11-02T04:10:14.097ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
100242024-11-02T04:10:14.097ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
100252024-11-02T04:10:14.097ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
100262024-11-02T04:10:14.099ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 554.480338ms iteration = 28 status = {}
100272024-11-02T04:10:14.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100282024-11-02T04:10:14.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100292024-11-02T04:10:14.119ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
100302024-11-02T04:10:14.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100312024-11-02T04:10:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100322024-11-02T04:10:14.126ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100332024-11-02T04:10:14.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b0064b-cd2b-4264-8612-06d5bcdb2785", "content-length": "134", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
100342024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100352024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
100362024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100372024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100382024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100392024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100402024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100412024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100422024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100432024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100442024-11-02T04:10:14.127ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
100452024-11-02T04:10:14.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100462024-11-02T04:10:14.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100472024-11-02T04:10:14.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100482024-11-02T04:10:14.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f415fad-3fca-4b70-91e6-a8b45c0fb11a", "content-length": "2", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
100492024-11-02T04:10:14.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100502024-11-02T04:10:14.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6dffe18-1f49-498c-84ee-a0b937332c1a", "content-length": "52", "date": "Sat, 02 Nov 2024 04:10:13 GMT"} })
100512024-11-02T04:10:14.130ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
100522024-11-02T04:10:14.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100532024-11-02T04:10:14.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3949ca59-f435-4581-8137-3690088d9f74", "date": "Sat, 02 Nov 2024 04:10:14 GMT"} })
100542024-11-02T04:10:14.231ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
100552024-11-02T04:10:14.231ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100562024-11-02T04:10:14.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a12246e-353b-4bf1-82fb-831cf4d0f450", "content-length": "682", "date": "Sat, 02 Nov 2024 04:10:14 GMT"} })
100572024-11-02T04:10:14.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100582024-11-02T04:10:14.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100592024-11-02T04:10:14.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100602024-11-02T04:10:14.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100612024-11-02T04:10:14.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100622024-11-02T04:10:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100632024-11-02T04:10:14.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100642024-11-02T04:10:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100652024-11-02T04:10:14.249ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.343868ms iteration = 27 status = {}
100662024-11-02T04:10:14.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7222eab1-6ae2-4e16-92aa-c766c7fbba25 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100672024-11-02T04:10:14.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7222eab1-6ae2-4e16-92aa-c766c7fbba25 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100682024-11-02T04:10:14.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7222eab1-6ae2-4e16-92aa-c766c7fbba25 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100692024-11-02T04:10:15.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 737da372-996c-41e7-9224-66ff9bdce51c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100702024-11-02T04:10:15.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 737da372-996c-41e7-9224-66ff9bdce51c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100712024-11-02T04:10:15.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 737da372-996c-41e7-9224-66ff9bdce51c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100722024-11-02T04:10:16.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0dd4cd08-a1d7-40f6-ae4f-d896229e915f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100732024-11-02T04:10:16.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0dd4cd08-a1d7-40f6-ae4f-d896229e915f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100742024-11-02T04:10:16.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0dd4cd08-a1d7-40f6-ae4f-d896229e915f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100752024-11-02T04:10:17.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8217ca2-345c-4efa-a531-c88ae042db2e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100762024-11-02T04:10:17.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8217ca2-345c-4efa-a531-c88ae042db2e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100772024-11-02T04:10:17.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8217ca2-345c-4efa-a531-c88ae042db2e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100782024-11-02T04:10:18.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b0c6b31-4bf3-4214-9d12-30bbf24096b4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100792024-11-02T04:10:18.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b0c6b31-4bf3-4214-9d12-30bbf24096b4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100802024-11-02T04:10:19.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0b0c6b31-4bf3-4214-9d12-30bbf24096b4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100812024-11-02T04:10:20.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d5a2efce-8e4f-4840-ba05-1ffcabaeb349 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100822024-11-02T04:10:20.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d5a2efce-8e4f-4840-ba05-1ffcabaeb349 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100832024-11-02T04:10:20.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d5a2efce-8e4f-4840-ba05-1ffcabaeb349 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100842024-11-02T04:10:21.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a90e765-80af-4e66-b481-f69829eb05c7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100852024-11-02T04:10:21.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a90e765-80af-4e66-b481-f69829eb05c7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100862024-11-02T04:10:21.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4a90e765-80af-4e66-b481-f69829eb05c7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100872024-11-02T04:10:22.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5d99102-34ec-48cb-8007-566110a4ff6d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100882024-11-02T04:10:22.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5d99102-34ec-48cb-8007-566110a4ff6d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100892024-11-02T04:10:22.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e5d99102-34ec-48cb-8007-566110a4ff6d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100902024-11-02T04:10:23.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03bca2b0-048e-4f17-aa12-af50cdbf4f0c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100912024-11-02T04:10:23.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03bca2b0-048e-4f17-aa12-af50cdbf4f0c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100922024-11-02T04:10:23.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 03bca2b0-048e-4f17-aa12-af50cdbf4f0c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
100932024-11-02T04:10:23.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
100942024-11-02T04:10:23.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
100952024-11-02T04:10:23.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100962024-11-02T04:10:23.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100972024-11-02T04:10:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100982024-11-02T04:10:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100992024-11-02T04:10:23.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101002024-11-02T04:10:23.547ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101012024-11-02T04:10:23.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101022024-11-02T04:10:23.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.709989ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101032024-11-02T04:10:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101042024-11-02T04:10:23.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101052024-11-02T04:10:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101062024-11-02T04:10:23.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101072024-11-02T04:10:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101082024-11-02T04:10:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101092024-11-02T04:10:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
101102024-11-02T04:10:23.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101112024-11-02T04:10:23.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101122024-11-02T04:10:23.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
101132024-11-02T04:10:23.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.304532ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
101142024-11-02T04:10:23.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 1119d30d-43d1-4995-9d9a-f3a40f0eb3f2 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
101152024-11-02T04:10:24.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66e25a66-1d4a-45f8-b26c-aa74cb9203a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101162024-11-02T04:10:24.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66e25a66-1d4a-45f8-b26c-aa74cb9203a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101172024-11-02T04:10:24.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 66e25a66-1d4a-45f8-b26c-aa74cb9203a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101182024-11-02T04:10:25.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a889f361-8b59-4f33-868f-ff6405dc0151 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101192024-11-02T04:10:25.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a889f361-8b59-4f33-868f-ff6405dc0151 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101202024-11-02T04:10:25.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a889f361-8b59-4f33-868f-ff6405dc0151 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101212024-11-02T04:10:26.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11b83cb8-0f43-4466-a850-6f945398abf8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101222024-11-02T04:10:26.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11b83cb8-0f43-4466-a850-6f945398abf8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101232024-11-02T04:10:26.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 11b83cb8-0f43-4466-a850-6f945398abf8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101242024-11-02T04:10:27.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d8d1649-12c5-447b-b402-5eb14aca95d6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101252024-11-02T04:10:27.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d8d1649-12c5-447b-b402-5eb14aca95d6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101262024-11-02T04:10:27.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1d8d1649-12c5-447b-b402-5eb14aca95d6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101272024-11-02T04:10:27.630ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
101282024-11-02T04:10:27.630ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
101292024-11-02T04:10:27.661ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
101302024-11-02T04:10:27.661ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47419
101312024-11-02T04:10:27.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47419 req_id = e7ea3710-6fa1-44e3-86d3-8584db06e365 roles = RoleSet { roles: {} } uri = /metrics/producers
101322024-11-02T04:10:27.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47419 req_id = e7ea3710-6fa1-44e3-86d3-8584db06e365 resource = Database result = Ok(()) uri = /metrics/producers
101332024-11-02T04:10:27.694ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
101342024-11-02T04:10:27.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33060 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47419 req_id = e7ea3710-6fa1-44e3-86d3-8584db06e365 response_code = 201 uri = /metrics/producers
101352024-11-02T04:10:27.694ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e7ea3710-6fa1-44e3-86d3-8584db06e365", "content-length": "41", "date": "Sat, 02 Nov 2024 04:10:27 GMT"} })
101362024-11-02T04:10:27.695ZDEBGnexus (producer-registration-task): registered with nexus successfully
101372024-11-02T04:10:27.695ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
101382024-11-02T04:10:28.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d29ccd0e-a19d-4839-bd95-cd16595ae89c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101392024-11-02T04:10:28.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d29ccd0e-a19d-4839-bd95-cd16595ae89c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101402024-11-02T04:10:28.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d29ccd0e-a19d-4839-bd95-cd16595ae89c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101412024-11-02T04:10:29.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61077ad3-5765-4328-9827-fa4342e42ef0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101422024-11-02T04:10:29.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61077ad3-5765-4328-9827-fa4342e42ef0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101432024-11-02T04:10:29.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 61077ad3-5765-4328-9827-fa4342e42ef0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101442024-11-02T04:10:30.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6ab16dd-091b-4807-9ea9-9bddd1cd189a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101452024-11-02T04:10:30.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6ab16dd-091b-4807-9ea9-9bddd1cd189a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101462024-11-02T04:10:30.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e6ab16dd-091b-4807-9ea9-9bddd1cd189a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101472024-11-02T04:10:31.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41db0fce-3566-435f-9cda-3290cc6d1d9f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101482024-11-02T04:10:31.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41db0fce-3566-435f-9cda-3290cc6d1d9f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101492024-11-02T04:10:31.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41db0fce-3566-435f-9cda-3290cc6d1d9f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101502024-11-02T04:10:32.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = afe54ace-153b-4115-8d5b-4242b1f163d3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101512024-11-02T04:10:32.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = afe54ace-153b-4115-8d5b-4242b1f163d3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101522024-11-02T04:10:32.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = afe54ace-153b-4115-8d5b-4242b1f163d3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101532024-11-02T04:10:33.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b604c91-1a27-4edd-9e45-850bec44d7ba roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101542024-11-02T04:10:33.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b604c91-1a27-4edd-9e45-850bec44d7ba resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101552024-11-02T04:10:33.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2b604c91-1a27-4edd-9e45-850bec44d7ba response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101562024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
101572024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
101582024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101592024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101602024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101612024-11-02T04:10:33.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101622024-11-02T04:10:33.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101632024-11-02T04:10:33.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101642024-11-02T04:10:33.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101652024-11-02T04:10:33.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.492847ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101662024-11-02T04:10:33.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101672024-11-02T04:10:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101682024-11-02T04:10:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101692024-11-02T04:10:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101702024-11-02T04:10:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101712024-11-02T04:10:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101722024-11-02T04:10:33.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
101732024-11-02T04:10:33.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101742024-11-02T04:10:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101752024-11-02T04:10:33.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
101762024-11-02T04:10:33.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.178396ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
101772024-11-02T04:10:34.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d89b1642-30b1-4972-8115-43e707a5bae4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101782024-11-02T04:10:34.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d89b1642-30b1-4972-8115-43e707a5bae4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101792024-11-02T04:10:34.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d89b1642-30b1-4972-8115-43e707a5bae4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101802024-11-02T04:10:35.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd0733e5-ce9c-4583-86ce-7d4e6140a19e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101812024-11-02T04:10:35.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd0733e5-ce9c-4583-86ce-7d4e6140a19e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101822024-11-02T04:10:35.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cd0733e5-ce9c-4583-86ce-7d4e6140a19e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101832024-11-02T04:10:36.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b4bde6b6-6233-4fb4-9a2f-e3eb09dd7441 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101842024-11-02T04:10:36.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b4bde6b6-6233-4fb4-9a2f-e3eb09dd7441 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101852024-11-02T04:10:36.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b4bde6b6-6233-4fb4-9a2f-e3eb09dd7441 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101862024-11-02T04:10:37.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ebc1d45-b56c-459b-832d-f880e8cbb376 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101872024-11-02T04:10:37.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ebc1d45-b56c-459b-832d-f880e8cbb376 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101882024-11-02T04:10:37.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1ebc1d45-b56c-459b-832d-f880e8cbb376 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101892024-11-02T04:10:37.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 9e580377-0341-4bcb-a41b-71b62efae0b4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
101902024-11-02T04:10:37.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 9e580377-0341-4bcb-a41b-71b62efae0b4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
101912024-11-02T04:10:37.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 9e580377-0341-4bcb-a41b-71b62efae0b4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
101922024-11-02T04:10:38.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d314f173-f05f-41c0-af7f-41c0887c8e03 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101932024-11-02T04:10:38.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d314f173-f05f-41c0-af7f-41c0887c8e03 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101942024-11-02T04:10:38.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d314f173-f05f-41c0-af7f-41c0887c8e03 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101952024-11-02T04:10:38.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = c8fd3cf7-beb6-4843-a409-888cbbbb34a1 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
101962024-11-02T04:10:39.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08313d60-aa90-433b-9b28-66ec7b73c2ef roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101972024-11-02T04:10:39.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08313d60-aa90-433b-9b28-66ec7b73c2ef resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101982024-11-02T04:10:39.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 08313d60-aa90-433b-9b28-66ec7b73c2ef response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
101992024-11-02T04:10:40.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff798545-2693-44b2-a59f-6fab48733882 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102002024-11-02T04:10:40.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff798545-2693-44b2-a59f-6fab48733882 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102012024-11-02T04:10:40.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff798545-2693-44b2-a59f-6fab48733882 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102022024-11-02T04:10:41.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2bce6968-dd5f-42c1-9d7a-93c9d79cf7eb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102032024-11-02T04:10:41.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2bce6968-dd5f-42c1-9d7a-93c9d79cf7eb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102042024-11-02T04:10:41.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2bce6968-dd5f-42c1-9d7a-93c9d79cf7eb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102052024-11-02T04:10:42.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 499522df-9d84-45ce-a908-40b8dbbaa722 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102062024-11-02T04:10:42.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 499522df-9d84-45ce-a908-40b8dbbaa722 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102072024-11-02T04:10:42.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 499522df-9d84-45ce-a908-40b8dbbaa722 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
102082024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
102092024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
102102024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102112024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102122024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
102132024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102142024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
102152024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
102162024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102172024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102182024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
102192024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102202024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102212024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
102222024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102232024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
102242024-11-02T04:10:43.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102252024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102262024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
102272024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
102282024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
102292024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
102302024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102312024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102322024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102332024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
102342024-11-02T04:10:43.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102352024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102362024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102372024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102382024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102392024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102402024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102412024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102422024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102432024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102442024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102452024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102462024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102472024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
102482024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
102492024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.62\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
102502024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
102512024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
102522024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.291\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
102532024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.52\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
102542024-11-02T04:10:43.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.691\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102552024-11-02T04:10:43.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102562024-11-02T04:10:43.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102572024-11-02T04:10:43.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102582024-11-02T04:10:43.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10147, tv_nsec: 522259088 } })
102592024-11-02T04:10:43.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102602024-11-02T04:10:43.548ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.534446ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102612024-11-02T04:10:43.548ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
102622024-11-02T04:10:43.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102632024-11-02T04:10:43.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102642024-11-02T04:10:43.549ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102652024-11-02T04:10:43.549ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102662024-11-02T04:10:43.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102672024-11-02T04:10:43.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102682024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102692024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102702024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102712024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102722024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102732024-11-02T04:10:43.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102742024-11-02T04:10:43.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102752024-11-02T04:10:43.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102762024-11-02T04:10:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102772024-11-02T04:10:43.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102782024-11-02T04:10:43.554ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10147, tv_nsec: 528029982 } })
102792024-11-02T04:10:43.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
102802024-11-02T04:10:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102812024-11-02T04:10:43.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102822024-11-02T04:10:43.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102832024-11-02T04:10:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102842024-11-02T04:10:43.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102852024-11-02T04:10:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102862024-11-02T04:10:43.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102872024-11-02T04:10:43.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102882024-11-02T04:10:43.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102892024-11-02T04:10:43.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.59467ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102902024-11-02T04:10:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102912024-11-02T04:10:43.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102922024-11-02T04:10:43.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102932024-11-02T04:10:43.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10147, tv_nsec: 532850996 } })
102942024-11-02T04:10:43.559ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
102952024-11-02T04:10:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102962024-11-02T04:10:43.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102972024-11-02T04:10:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102982024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102992024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103002024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.695519ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103012024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103022024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103032024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103042024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103052024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103062024-11-02T04:10:43.561ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103072024-11-02T04:10:43.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.280931ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103082024-11-02T04:10:43.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103092024-11-02T04:10:43.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103102024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103112024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103122024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
103132024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103142024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103152024-11-02T04:10:43.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103162024-11-02T04:10:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45726b1c-52fa-4ad3-a80e-fa61813801ef roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
103172024-11-02T04:10:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45726b1c-52fa-4ad3-a80e-fa61813801ef resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
103182024-11-02T04:10:43.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 45726b1c-52fa-4ad3-a80e-fa61813801ef response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
103192024-11-02T04:10:43.580ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 35.494193ms iteration = 32 status = {"physical_disks_added":0}
103202024-11-02T04:10:43.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
103212024-11-02T04:10:43.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.568138ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
103222024-11-02T04:10:43.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103232024-11-02T04:10:43.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103242024-11-02T04:10:43.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103252024-11-02T04:10:43.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103262024-11-02T04:10:43.593ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103272024-11-02T04:10:43.593ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103282024-11-02T04:10:43.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103292024-11-02T04:10:43.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103302024-11-02T04:10:43.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103312024-11-02T04:10:43.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103322024-11-02T04:10:43.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
103332024-11-02T04:10:43.655ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103342024-11-02T04:10:43.655ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e17aee9f-f61d-490c-b0d4-651034e5f572", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103352024-11-02T04:10:43.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103362024-11-02T04:10:43.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103372024-11-02T04:10:43.712ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103382024-11-02T04:10:43.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103392024-11-02T04:10:43.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103402024-11-02T04:10:43.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
103412024-11-02T04:10:43.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103422024-11-02T04:10:43.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103432024-11-02T04:10:43.718ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 173.478915ms iteration = 28 status = 0
103442024-11-02T04:10:43.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103452024-11-02T04:10:43.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103462024-11-02T04:10:43.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103472024-11-02T04:10:43.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103482024-11-02T04:10:43.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103492024-11-02T04:10:43.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103502024-11-02T04:10:43.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103512024-11-02T04:10:43.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103522024-11-02T04:10:43.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103532024-11-02T04:10:43.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103542024-11-02T04:10:43.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103552024-11-02T04:10:43.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103562024-11-02T04:10:43.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 197.749257ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103572024-11-02T04:10:43.788ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
103582024-11-02T04:10:43.788ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103592024-11-02T04:10:43.788ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d317c7e2-dfd5-49ce-9e3d-340cd314f8c5", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103602024-11-02T04:10:43.788ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103612024-11-02T04:10:43.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
103622024-11-02T04:10:43.791ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
103632024-11-02T04:10:43.791ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103642024-11-02T04:10:43.791ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71f45b74-a7c6-485a-96e1-3b91de8e89dd", "content-length": "26", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103652024-11-02T04:10:43.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103662024-11-02T04:10:43.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103672024-11-02T04:10:43.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e25f177b-3301-4335-9858-3f6442190d86", "content-length": "372", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103682024-11-02T04:10:43.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103692024-11-02T04:10:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103702024-11-02T04:10:43.818ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103712024-11-02T04:10:43.818ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "375d7722-a2b5-416f-b695-0898ee87b11a", "content-length": "2", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103722024-11-02T04:10:43.820ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103732024-11-02T04:10:43.820ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103742024-11-02T04:10:43.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103752024-11-02T04:10:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103762024-11-02T04:10:43.821ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db9a3b5b-1fa9-4f6c-b9a4-a6d88a7143d5", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103772024-11-02T04:10:43.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103782024-11-02T04:10:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103792024-11-02T04:10:43.822ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.899579ms iteration = 28 status = null
103802024-11-02T04:10:43.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103812024-11-02T04:10:43.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103822024-11-02T04:10:43.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103832024-11-02T04:10:43.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103842024-11-02T04:10:43.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103852024-11-02T04:10:43.847ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c33c6788-e901-49bc-9df0-4b86c4ff7ff6", "content-length": "691", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103862024-11-02T04:10:43.847ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103872024-11-02T04:10:43.847ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103882024-11-02T04:10:43.847ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103892024-11-02T04:10:43.848ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 303.526879ms iteration = 29 status = {}
103902024-11-02T04:10:43.850ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103912024-11-02T04:10:43.850ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103922024-11-02T04:10:43.850ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3125771-74dc-4c25-a57c-095659d3176d", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
103932024-11-02T04:10:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 307.268349ms iteration = 30 status = {}
103942024-11-02T04:10:43.875ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.445087ms iteration = 28 status = {}
103952024-11-02T04:10:43.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103962024-11-02T04:10:43.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103972024-11-02T04:10:43.946ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
103982024-11-02T04:10:43.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103992024-11-02T04:10:43.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104002024-11-02T04:10:43.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
104012024-11-02T04:10:43.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4a22d14-03ec-4e48-9e82-a55e099a9bcc", "content-length": "134", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
104022024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104032024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
104042024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104052024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104062024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104072024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104082024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104092024-11-02T04:10:43.958ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104102024-11-02T04:10:43.959ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104112024-11-02T04:10:43.959ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104122024-11-02T04:10:43.959ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
104132024-11-02T04:10:43.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104142024-11-02T04:10:43.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104152024-11-02T04:10:43.961ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104162024-11-02T04:10:43.961ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bf9361b-bb02-42e1-bade-8213d3e58020", "content-length": "2", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
104172024-11-02T04:10:43.961ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104182024-11-02T04:10:43.961ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e28e058-0ddd-49dd-9b6f-6e0b05bd4665", "content-length": "52", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
104192024-11-02T04:10:43.961ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
104202024-11-02T04:10:43.962ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104212024-11-02T04:10:44.072ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "33a2e1d8-e0ea-4049-993e-89e4e38275b5", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
104222024-11-02T04:10:44.072ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
104232024-11-02T04:10:44.072ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104242024-11-02T04:10:44.072ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "60c9e45d-2e82-43a8-94cf-892fefea6296", "content-length": "682", "date": "Sat, 02 Nov 2024 04:10:43 GMT"} })
104252024-11-02T04:10:44.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104262024-11-02T04:10:44.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104272024-11-02T04:10:44.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104282024-11-02T04:10:44.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104292024-11-02T04:10:44.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104302024-11-02T04:10:44.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104312024-11-02T04:10:44.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104322024-11-02T04:10:44.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104332024-11-02T04:10:44.090ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.339942ms iteration = 28 status = {}
104342024-11-02T04:10:44.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f552c840-9350-43bf-897c-eb331c020e34 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104352024-11-02T04:10:44.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f552c840-9350-43bf-897c-eb331c020e34 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104362024-11-02T04:10:44.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f552c840-9350-43bf-897c-eb331c020e34 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104372024-11-02T04:10:45.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a116ecb5-d86a-4964-a131-de6f7f85064b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104382024-11-02T04:10:45.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a116ecb5-d86a-4964-a131-de6f7f85064b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104392024-11-02T04:10:45.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a116ecb5-d86a-4964-a131-de6f7f85064b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104402024-11-02T04:10:46.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ddced219-1def-43cc-95e9-9c0350e66b36 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104412024-11-02T04:10:46.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ddced219-1def-43cc-95e9-9c0350e66b36 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104422024-11-02T04:10:46.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ddced219-1def-43cc-95e9-9c0350e66b36 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104432024-11-02T04:10:47.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c71e09a-9388-480a-b575-91143747168d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104442024-11-02T04:10:47.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c71e09a-9388-480a-b575-91143747168d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104452024-11-02T04:10:47.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6c71e09a-9388-480a-b575-91143747168d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104462024-11-02T04:10:48.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3b3a09d-ff52-487e-8dd4-34911f0fef50 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104472024-11-02T04:10:48.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3b3a09d-ff52-487e-8dd4-34911f0fef50 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104482024-11-02T04:10:48.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3b3a09d-ff52-487e-8dd4-34911f0fef50 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104492024-11-02T04:10:49.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 456db041-221d-4f8f-839f-0852331159fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104502024-11-02T04:10:49.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 456db041-221d-4f8f-839f-0852331159fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104512024-11-02T04:10:49.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 456db041-221d-4f8f-839f-0852331159fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104522024-11-02T04:10:50.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca31585a-081a-4695-a748-5b61fa3b1587 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104532024-11-02T04:10:50.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca31585a-081a-4695-a748-5b61fa3b1587 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104542024-11-02T04:10:50.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ca31585a-081a-4695-a748-5b61fa3b1587 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104552024-11-02T04:10:51.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f722b5c-28fe-44f2-b922-e28dd831d2b5 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104562024-11-02T04:10:51.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f722b5c-28fe-44f2-b922-e28dd831d2b5 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104572024-11-02T04:10:51.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6f722b5c-28fe-44f2-b922-e28dd831d2b5 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104582024-11-02T04:10:52.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e348a24f-efba-4d02-bcc1-9e2f60012656 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104592024-11-02T04:10:52.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e348a24f-efba-4d02-bcc1-9e2f60012656 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104602024-11-02T04:10:52.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e348a24f-efba-4d02-bcc1-9e2f60012656 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104612024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
104622024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
104632024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104642024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104652024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104662024-11-02T04:10:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104672024-11-02T04:10:53.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104682024-11-02T04:10:53.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104692024-11-02T04:10:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104702024-11-02T04:10:53.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.598169ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104712024-11-02T04:10:53.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104722024-11-02T04:10:53.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104732024-11-02T04:10:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104742024-11-02T04:10:53.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104752024-11-02T04:10:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104762024-11-02T04:10:53.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104772024-11-02T04:10:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
104782024-11-02T04:10:53.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104792024-11-02T04:10:53.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104802024-11-02T04:10:53.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
104812024-11-02T04:10:53.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.000528ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
104822024-11-02T04:10:53.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = beb565eb-92b3-4954-ad1b-11a49a59f6db roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104832024-11-02T04:10:53.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = beb565eb-92b3-4954-ad1b-11a49a59f6db resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104842024-11-02T04:10:53.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = beb565eb-92b3-4954-ad1b-11a49a59f6db response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104852024-11-02T04:10:53.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1319 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 505c3d07-5f10-4a4c-aa14-00aac9ff8c6d response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
104862024-11-02T04:10:54.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5103ba10-110c-4087-a012-bcaf4dcd96f8 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104872024-11-02T04:10:54.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5103ba10-110c-4087-a012-bcaf4dcd96f8 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104882024-11-02T04:10:54.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5103ba10-110c-4087-a012-bcaf4dcd96f8 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104892024-11-02T04:10:55.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2f528fd8-6538-4899-bd53-f39624020819 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104902024-11-02T04:10:55.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2f528fd8-6538-4899-bd53-f39624020819 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104912024-11-02T04:10:55.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2f528fd8-6538-4899-bd53-f39624020819 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104922024-11-02T04:10:56.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 310258ac-c967-4338-94ed-5e1aba07e9a6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104932024-11-02T04:10:56.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 310258ac-c967-4338-94ed-5e1aba07e9a6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104942024-11-02T04:10:56.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 310258ac-c967-4338-94ed-5e1aba07e9a6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104952024-11-02T04:10:57.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97fd535d-2e27-4941-a897-b4c953ba51a9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104962024-11-02T04:10:57.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97fd535d-2e27-4941-a897-b4c953ba51a9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104972024-11-02T04:10:57.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 97fd535d-2e27-4941-a897-b4c953ba51a9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104982024-11-02T04:10:58.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c6514a2-cd79-4629-a0d6-2054e4dbc459 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
104992024-11-02T04:10:58.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c6514a2-cd79-4629-a0d6-2054e4dbc459 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105002024-11-02T04:10:58.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5c6514a2-cd79-4629-a0d6-2054e4dbc459 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105012024-11-02T04:10:59.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3449a5a1-3162-41d5-b62b-cf2d5baa426c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105022024-11-02T04:10:59.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3449a5a1-3162-41d5-b62b-cf2d5baa426c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105032024-11-02T04:10:59.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3449a5a1-3162-41d5-b62b-cf2d5baa426c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105042024-11-02T04:11:00.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41edf777-3010-4c44-8a49-cb6aa25cf015 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105052024-11-02T04:11:00.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41edf777-3010-4c44-8a49-cb6aa25cf015 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105062024-11-02T04:11:00.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 41edf777-3010-4c44-8a49-cb6aa25cf015 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105072024-11-02T04:11:02.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 942c3927-ed71-43eb-b2c3-b234b53d5ac4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105082024-11-02T04:11:02.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 942c3927-ed71-43eb-b2c3-b234b53d5ac4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105092024-11-02T04:11:02.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 942c3927-ed71-43eb-b2c3-b234b53d5ac4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105102024-11-02T04:11:03.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e3d2e49-8abd-4b36-aea6-1efb3c8443d1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105112024-11-02T04:11:03.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e3d2e49-8abd-4b36-aea6-1efb3c8443d1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105122024-11-02T04:11:03.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e3d2e49-8abd-4b36-aea6-1efb3c8443d1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105132024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
105142024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105152024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
105162024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105172024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105182024-11-02T04:11:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105192024-11-02T04:11:03.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105202024-11-02T04:11:03.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105212024-11-02T04:11:03.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105222024-11-02T04:11:03.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.489705ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105232024-11-02T04:11:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105242024-11-02T04:11:03.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105252024-11-02T04:11:03.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105262024-11-02T04:11:03.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105272024-11-02T04:11:03.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105282024-11-02T04:11:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105292024-11-02T04:11:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
105302024-11-02T04:11:03.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105312024-11-02T04:11:03.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105322024-11-02T04:11:03.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
105332024-11-02T04:11:03.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.707533ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
105342024-11-02T04:11:04.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b325bc9-7989-4ebe-a803-ac5db88a6f33 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105352024-11-02T04:11:04.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b325bc9-7989-4ebe-a803-ac5db88a6f33 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105362024-11-02T04:11:04.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9b325bc9-7989-4ebe-a803-ac5db88a6f33 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105372024-11-02T04:11:05.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb1095c0-b9bb-4235-a8a9-b79e987d4b29 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105382024-11-02T04:11:05.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb1095c0-b9bb-4235-a8a9-b79e987d4b29 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105392024-11-02T04:11:05.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb1095c0-b9bb-4235-a8a9-b79e987d4b29 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105402024-11-02T04:11:06.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5283450f-7de1-4a02-819a-9c5e7f1a700e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105412024-11-02T04:11:06.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5283450f-7de1-4a02-819a-9c5e7f1a700e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105422024-11-02T04:11:06.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5283450f-7de1-4a02-819a-9c5e7f1a700e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105432024-11-02T04:11:06.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 549a7397-17c6-4134-9888-f2ef32a3ff4f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
105442024-11-02T04:11:06.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 549a7397-17c6-4134-9888-f2ef32a3ff4f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
105452024-11-02T04:11:06.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 549a7397-17c6-4134-9888-f2ef32a3ff4f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
105462024-11-02T04:11:07.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2cadc681-796f-4b60-ba27-7e8bb54c3dd4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105472024-11-02T04:11:07.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2cadc681-796f-4b60-ba27-7e8bb54c3dd4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105482024-11-02T04:11:07.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2cadc681-796f-4b60-ba27-7e8bb54c3dd4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105492024-11-02T04:11:08.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35e3f711-7514-4bae-ac4a-46b96d6c76e6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105502024-11-02T04:11:08.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35e3f711-7514-4bae-ac4a-46b96d6c76e6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105512024-11-02T04:11:08.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 35e3f711-7514-4bae-ac4a-46b96d6c76e6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105522024-11-02T04:11:08.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = dd20acf1-f79a-4c89-954f-28e2765005f4 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
105532024-11-02T04:11:09.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c80f3ab-d5c0-4def-8cf7-93ea7f616dc3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105542024-11-02T04:11:09.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c80f3ab-d5c0-4def-8cf7-93ea7f616dc3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105552024-11-02T04:11:09.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 4c80f3ab-d5c0-4def-8cf7-93ea7f616dc3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105562024-11-02T04:11:10.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34ea2e98-a84e-427e-847d-e0f0f1b37f3d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105572024-11-02T04:11:10.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34ea2e98-a84e-427e-847d-e0f0f1b37f3d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105582024-11-02T04:11:10.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 34ea2e98-a84e-427e-847d-e0f0f1b37f3d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105592024-11-02T04:11:11.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55435d20-bba6-4491-a729-c15b73dff0db roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105602024-11-02T04:11:11.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55435d20-bba6-4491-a729-c15b73dff0db resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105612024-11-02T04:11:11.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 55435d20-bba6-4491-a729-c15b73dff0db response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105622024-11-02T04:11:12.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ac877bb-3387-480c-a6cd-b1c47e212a07 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105632024-11-02T04:11:12.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ac877bb-3387-480c-a6cd-b1c47e212a07 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105642024-11-02T04:11:12.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8ac877bb-3387-480c-a6cd-b1c47e212a07 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105652024-11-02T04:11:13.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb3ee463-20b1-49fb-a157-a0fad22d6253 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105662024-11-02T04:11:13.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb3ee463-20b1-49fb-a157-a0fad22d6253 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105672024-11-02T04:11:13.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = bb3ee463-20b1-49fb-a157-a0fad22d6253 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
105682024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
105692024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105702024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
105712024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
105722024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105732024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
105742024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
105752024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105762024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
105772024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
105782024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105792024-11-02T04:11:13.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105802024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105812024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
105822024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
105832024-11-02T04:11:13.544ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
105842024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
105852024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.06\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
105862024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
105872024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105882024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
105892024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105902024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105912024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
105922024-11-02T04:11:13.544ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 04:01:13.544546888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105932024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105942024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
105952024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105962024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
105972024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105982024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105992024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
106002024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
106012024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
106022024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106032024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
106042024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
106052024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106062024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
106072024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
106082024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106092024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
106102024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106112024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106122024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
106132024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
106142024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106152024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
106162024-11-02T04:11:13.544ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
106172024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106182024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106192024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106202024-11-02T04:11:13.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106212024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106222024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106232024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106242024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106252024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106262024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106272024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106282024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106292024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
106302024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
106312024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106322024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
106332024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
106342024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.781\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
106352024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106362024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
106372024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
106382024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
106392024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
106402024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.99\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106412024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106422024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.3\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
106432024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.94\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106442024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106452024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106462024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106472024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106482024-11-02T04:11:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 10177, tv_nsec: 519053420 } })
106492024-11-02T04:11:13.545ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 10177, tv_nsec: 519058470 } })
106502024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106512024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106522024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
106532024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.096414ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
106542024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
106552024-11-02T04:11:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.351379ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
106562024-11-02T04:11:13.546ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106572024-11-02T04:11:13.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106582024-11-02T04:11:13.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106592024-11-02T04:11:13.548ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.305942ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106602024-11-02T04:11:13.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106612024-11-02T04:11:13.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106622024-11-02T04:11:13.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10177, tv_nsec: 523933575 } })
106632024-11-02T04:11:13.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106642024-11-02T04:11:13.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106652024-11-02T04:11:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106662024-11-02T04:11:13.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
106672024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106682024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106692024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106702024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106712024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106722024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106732024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106742024-11-02T04:11:13.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106752024-11-02T04:11:13.552ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 04:01:13.544546888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106762024-11-02T04:11:13.552ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.776457ms iteration = 15 status = {"expiration":"2024-11-02T04:01:13.544546888Z","pruned":[]}
106772024-11-02T04:11:13.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10177, tv_nsec: 527312367 } })
106782024-11-02T04:11:13.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
106792024-11-02T04:11:13.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802024-11-02T04:11:13.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106812024-11-02T04:11:13.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106822024-11-02T04:11:13.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106832024-11-02T04:11:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106842024-11-02T04:11:13.556ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106852024-11-02T04:11:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106862024-11-02T04:11:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106872024-11-02T04:11:13.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106882024-11-02T04:11:13.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106892024-11-02T04:11:13.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106902024-11-02T04:11:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106912024-11-02T04:11:13.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106922024-11-02T04:11:13.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106932024-11-02T04:11:13.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942024-11-02T04:11:13.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106952024-11-02T04:11:13.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106962024-11-02T04:11:13.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106972024-11-02T04:11:13.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106982024-11-02T04:11:13.563ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.18675ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
106992024-11-02T04:11:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107002024-11-02T04:11:13.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107012024-11-02T04:11:13.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107022024-11-02T04:11:13.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107032024-11-02T04:11:13.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107042024-11-02T04:11:13.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10177, tv_nsec: 542866041 } })
107052024-11-02T04:11:13.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107062024-11-02T04:11:13.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
107072024-11-02T04:11:13.571ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107082024-11-02T04:11:13.571ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.756334ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107092024-11-02T04:11:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
107102024-11-02T04:11:13.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107112024-11-02T04:11:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107122024-11-02T04:11:13.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107132024-11-02T04:11:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107142024-11-02T04:11:13.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107152024-11-02T04:11:13.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107162024-11-02T04:11:13.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107172024-11-02T04:11:13.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107182024-11-02T04:11:13.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107192024-11-02T04:11:13.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.710376ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107202024-11-02T04:11:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107212024-11-02T04:11:13.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107222024-11-02T04:11:13.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107232024-11-02T04:11:13.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107242024-11-02T04:11:13.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107252024-11-02T04:11:13.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107262024-11-02T04:11:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107272024-11-02T04:11:13.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107282024-11-02T04:11:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.941372ms iteration = 33 status = {"physical_disks_added":0}
107292024-11-02T04:11:13.600ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107302024-11-02T04:11:13.600ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107312024-11-02T04:11:13.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107322024-11-02T04:11:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107332024-11-02T04:11:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
107342024-11-02T04:11:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107352024-11-02T04:11:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107362024-11-02T04:11:13.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107372024-11-02T04:11:13.603ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107382024-11-02T04:11:13.603ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107392024-11-02T04:11:13.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107402024-11-02T04:11:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107412024-11-02T04:11:13.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107422024-11-02T04:11:13.604ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107432024-11-02T04:11:13.604ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.339724ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107442024-11-02T04:11:13.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107452024-11-02T04:11:13.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107462024-11-02T04:11:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107472024-11-02T04:11:13.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107482024-11-02T04:11:13.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107492024-11-02T04:11:13.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107502024-11-02T04:11:13.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107512024-11-02T04:11:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107522024-11-02T04:11:13.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107532024-11-02T04:11:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107542024-11-02T04:11:13.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107552024-11-02T04:11:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107562024-11-02T04:11:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107572024-11-02T04:11:13.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107582024-11-02T04:11:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107592024-11-02T04:11:13.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.58877ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107602024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107612024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107622024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107632024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107642024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107652024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
107662024-11-02T04:11:13.611ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
107672024-11-02T04:11:13.611ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.208713ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107682024-11-02T04:11:13.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
107692024-11-02T04:11:13.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.632253ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
107702024-11-02T04:11:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107712024-11-02T04:11:13.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107722024-11-02T04:11:13.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107732024-11-02T04:11:13.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107742024-11-02T04:11:13.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107752024-11-02T04:11:13.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107762024-11-02T04:11:13.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107772024-11-02T04:11:13.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107782024-11-02T04:11:13.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107792024-11-02T04:11:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107802024-11-02T04:11:13.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107812024-11-02T04:11:13.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107822024-11-02T04:11:13.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107832024-11-02T04:11:13.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107842024-11-02T04:11:13.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107852024-11-02T04:11:13.651ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107862024-11-02T04:11:13.651ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107872024-11-02T04:11:13.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107882024-11-02T04:11:13.651ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107892024-11-02T04:11:13.651ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107902024-11-02T04:11:13.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.342405ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107912024-11-02T04:11:13.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107922024-11-02T04:11:13.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107932024-11-02T04:11:13.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107942024-11-02T04:11:13.668ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107952024-11-02T04:11:13.668ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107962024-11-02T04:11:13.668ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
107972024-11-02T04:11:13.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107982024-11-02T04:11:13.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107992024-11-02T04:11:13.675ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
108002024-11-02T04:11:13.675ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 130.679237ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
108012024-11-02T04:11:13.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108022024-11-02T04:11:13.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108032024-11-02T04:11:13.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
108042024-11-02T04:11:13.712ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
108052024-11-02T04:11:13.712ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 168.224613ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
108062024-11-02T04:11:13.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
108072024-11-02T04:11:13.727ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108082024-11-02T04:11:13.727ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05fd6d82-2829-4429-baa0-5182f3603fb8", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:12 GMT"} })
108092024-11-02T04:11:13.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108102024-11-02T04:11:13.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108112024-11-02T04:11:13.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
108122024-11-02T04:11:13.738ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108132024-11-02T04:11:13.738ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b91d0550-f4f6-4d92-9f3b-52692e2ab1c5", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:12 GMT"} })
108142024-11-02T04:11:13.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108152024-11-02T04:11:13.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108162024-11-02T04:11:13.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
108172024-11-02T04:11:13.756ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108182024-11-02T04:11:13.756ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e6eb4e1-3e79-4203-968d-610cc770c0c5", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:12 GMT"} })
108192024-11-02T04:11:13.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108202024-11-02T04:11:13.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
108212024-11-02T04:11:13.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108222024-11-02T04:11:13.958ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108232024-11-02T04:11:13.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108242024-11-02T04:11:13.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108252024-11-02T04:11:13.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108262024-11-02T04:11:13.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108272024-11-02T04:11:13.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108282024-11-02T04:11:13.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108292024-11-02T04:11:13.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108302024-11-02T04:11:13.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108312024-11-02T04:11:13.964ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108322024-11-02T04:11:13.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108332024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108342024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
108352024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108362024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108372024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108382024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108392024-11-02T04:11:13.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108402024-11-02T04:11:13.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108412024-11-02T04:11:13.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108422024-11-02T04:11:13.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
108432024-11-02T04:11:13.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 422.475783ms iteration = 16 status = {"generation":1}
108442024-11-02T04:11:13.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108452024-11-02T04:11:13.968ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 423.529876ms iteration = 29 status = 0
108462024-11-02T04:11:13.968ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
108472024-11-02T04:11:13.968ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
108482024-11-02T04:11:13.968ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
108492024-11-02T04:11:13.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 423.942174ms iteration = 16 status = {"generation":2}
108502024-11-02T04:11:13.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108512024-11-02T04:11:13.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108522024-11-02T04:11:13.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108532024-11-02T04:11:13.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108542024-11-02T04:11:13.975ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f5266da5-423b-447f-894e-cbee3d0cb2d4", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108552024-11-02T04:11:13.975ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108562024-11-02T04:11:13.976ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5a06645f-4710-4054-aefa-de18bb1a0d5a", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108572024-11-02T04:11:13.976ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108582024-11-02T04:11:13.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "316aa0fb-1631-4da3-9e9b-c90f5a61831c", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108592024-11-02T04:11:13.978ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108602024-11-02T04:11:13.981ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
108612024-11-02T04:11:13.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.790271ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108622024-11-02T04:11:13.997ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.177542ms iteration = 29 status = {}
108632024-11-02T04:11:14.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108642024-11-02T04:11:14.003ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5a33c9c3-aece-41b8-af47-5ee059ac32b8", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108652024-11-02T04:11:14.003ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108662024-11-02T04:11:14.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3ebb9c4c-3a63-46f7-bbb8-731ccd57de01", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108672024-11-02T04:11:14.005ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108682024-11-02T04:11:14.007ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108692024-11-02T04:11:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 462.950983ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108702024-11-02T04:11:14.012ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108712024-11-02T04:11:14.012ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cad82a8-a2cf-4ddc-9483-f572b7242429", "content-length": "2", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
108722024-11-02T04:11:14.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108732024-11-02T04:11:14.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108742024-11-02T04:11:14.017ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.774483ms iteration = 29 status = null
108752024-11-02T04:11:14.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108762024-11-02T04:11:14.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108772024-11-02T04:11:14.067ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
108782024-11-02T04:11:14.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108792024-11-02T04:11:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108802024-11-02T04:11:14.069ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1dbfbff-cc9f-40b2-8964-a54caf9f23ba", "content-length": "372", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} })
108812024-11-02T04:11:14.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108822024-11-02T04:11:14.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108832024-11-02T04:11:14.073ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108842024-11-02T04:11:14.074ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bff369c1-95c6-41f8-8cb0-64cc5e7af52d", "content-length": "691", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
108852024-11-02T04:11:14.074ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
108862024-11-02T04:11:14.074ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
108872024-11-02T04:11:14.074ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
108882024-11-02T04:11:14.076ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 531.850642ms iteration = 30 status = {}
108892024-11-02T04:11:14.078ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108902024-11-02T04:11:14.078ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "68fe565b-ef63-4bde-a7e5-b4a63f7a3049", "content-length": "134", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
108912024-11-02T04:11:14.078ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108922024-11-02T04:11:14.078ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
108932024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108942024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108952024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108962024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108972024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108982024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108992024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109002024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109012024-11-02T04:11:14.079ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
109022024-11-02T04:11:14.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109032024-11-02T04:11:14.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109042024-11-02T04:11:14.082ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109052024-11-02T04:11:14.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe6fc14d-5efe-48aa-86a6-1628b8e46014", "content-length": "2", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
109062024-11-02T04:11:14.082ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109072024-11-02T04:11:14.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c742821-1521-4253-b3d4-2d75259aa8f9", "content-length": "52", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
109082024-11-02T04:11:14.082ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
109092024-11-02T04:11:14.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109102024-11-02T04:11:14.094ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109112024-11-02T04:11:14.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109122024-11-02T04:11:14.204ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8e941bac-3f86-4ec3-b529-53ab6bd9d91a", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
109132024-11-02T04:11:14.204ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
109142024-11-02T04:11:14.204ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109152024-11-02T04:11:14.205ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d1212b4c-fe65-47f8-9fb2-ec1dde89c4bc", "date": "Sat, 02 Nov 2024 04:11:13 GMT"} })
109162024-11-02T04:11:14.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109172024-11-02T04:11:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109182024-11-02T04:11:14.205ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f70c6e11-1ea2-41f8-aaf7-2ace3fbf5149", "content-length": "682", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
109192024-11-02T04:11:14.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109202024-11-02T04:11:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109212024-11-02T04:11:14.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109222024-11-02T04:11:14.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109232024-11-02T04:11:14.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109242024-11-02T04:11:14.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109252024-11-02T04:11:14.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109262024-11-02T04:11:14.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109272024-11-02T04:11:14.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109282024-11-02T04:11:14.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109292024-11-02T04:11:14.214ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109302024-11-02T04:11:14.214ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109312024-11-02T04:11:14.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109322024-11-02T04:11:14.215ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ea7d32dd-564f-4c70-be55-8b5a660aed5f", "date": "Sat, 02 Nov 2024 04:11:14 GMT"} })
109332024-11-02T04:11:14.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109342024-11-02T04:11:14.216ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 672.044532ms iteration = 31 status = {}
109352024-11-02T04:11:14.221ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 677.268264ms iteration = 29 status = {}
109362024-11-02T04:11:14.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d7825a7-18be-4502-8042-e86f882356a0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109372024-11-02T04:11:14.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d7825a7-18be-4502-8042-e86f882356a0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109382024-11-02T04:11:14.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9d7825a7-18be-4502-8042-e86f882356a0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109392024-11-02T04:11:15.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa3c6439-ceeb-421b-9d14-309c8faf256d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109402024-11-02T04:11:15.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa3c6439-ceeb-421b-9d14-309c8faf256d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109412024-11-02T04:11:15.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa3c6439-ceeb-421b-9d14-309c8faf256d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109422024-11-02T04:11:16.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9de454d6-56bb-4ef2-90dc-3907f4ec250f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109432024-11-02T04:11:16.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9de454d6-56bb-4ef2-90dc-3907f4ec250f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109442024-11-02T04:11:16.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9de454d6-56bb-4ef2-90dc-3907f4ec250f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109452024-11-02T04:11:17.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0413515d-07f3-41da-b88d-e273a3d30b71 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109462024-11-02T04:11:17.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0413515d-07f3-41da-b88d-e273a3d30b71 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109472024-11-02T04:11:17.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0413515d-07f3-41da-b88d-e273a3d30b71 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109482024-11-02T04:11:18.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a265b82e-10e3-4fa6-8a7c-9a6f846499a3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109492024-11-02T04:11:18.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a265b82e-10e3-4fa6-8a7c-9a6f846499a3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109502024-11-02T04:11:18.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a265b82e-10e3-4fa6-8a7c-9a6f846499a3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109512024-11-02T04:11:19.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3829a069-9d3f-450f-82ad-78cb6ce7c0ae roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109522024-11-02T04:11:19.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3829a069-9d3f-450f-82ad-78cb6ce7c0ae resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109532024-11-02T04:11:19.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3829a069-9d3f-450f-82ad-78cb6ce7c0ae response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109542024-11-02T04:11:20.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 699a0384-0f91-4257-b5b2-029ca69312bf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109552024-11-02T04:11:20.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 699a0384-0f91-4257-b5b2-029ca69312bf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109562024-11-02T04:11:20.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 699a0384-0f91-4257-b5b2-029ca69312bf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109572024-11-02T04:11:21.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f4a6e1d-b1cb-41bf-a31f-04c2364cc599 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109582024-11-02T04:11:21.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f4a6e1d-b1cb-41bf-a31f-04c2364cc599 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109592024-11-02T04:11:21.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f4a6e1d-b1cb-41bf-a31f-04c2364cc599 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109602024-11-02T04:11:22.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a4024b-24e1-4ac2-9f7a-3a14e7b2d054 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109612024-11-02T04:11:22.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a4024b-24e1-4ac2-9f7a-3a14e7b2d054 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109622024-11-02T04:11:22.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c7a4024b-24e1-4ac2-9f7a-3a14e7b2d054 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109632024-11-02T04:11:23.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69847563-fb0e-43fa-979f-420a673976cf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109642024-11-02T04:11:23.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69847563-fb0e-43fa-979f-420a673976cf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109652024-11-02T04:11:23.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
109662024-11-02T04:11:23.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109672024-11-02T04:11:23.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
109682024-11-02T04:11:23.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109692024-11-02T04:11:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109702024-11-02T04:11:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109712024-11-02T04:11:23.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 69847563-fb0e-43fa-979f-420a673976cf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109722024-11-02T04:11:23.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109732024-11-02T04:11:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109742024-11-02T04:11:23.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109752024-11-02T04:11:23.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109762024-11-02T04:11:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109772024-11-02T04:11:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109782024-11-02T04:11:23.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109792024-11-02T04:11:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
109802024-11-02T04:11:23.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109812024-11-02T04:11:23.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109822024-11-02T04:11:23.567ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
109832024-11-02T04:11:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.506994ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
109842024-11-02T04:11:23.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109852024-11-02T04:11:23.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109862024-11-02T04:11:23.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.515268ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109872024-11-02T04:11:23.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1471 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 7360e7d2-f114-438e-be56-7dc20d0066c9 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
109882024-11-02T04:11:24.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f588ac75-bca3-496c-8004-56f07afba199 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109892024-11-02T04:11:24.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f588ac75-bca3-496c-8004-56f07afba199 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109902024-11-02T04:11:24.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f588ac75-bca3-496c-8004-56f07afba199 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109912024-11-02T04:11:25.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0bda22ca-94cb-42dd-be86-3c414e7b21db roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109922024-11-02T04:11:25.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0bda22ca-94cb-42dd-be86-3c414e7b21db resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109932024-11-02T04:11:25.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0bda22ca-94cb-42dd-be86-3c414e7b21db response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109942024-11-02T04:11:26.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e51ddb96-7ebe-4235-9a7b-8091fc7f3ed0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109952024-11-02T04:11:26.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e51ddb96-7ebe-4235-9a7b-8091fc7f3ed0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109962024-11-02T04:11:26.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e51ddb96-7ebe-4235-9a7b-8091fc7f3ed0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109972024-11-02T04:11:27.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9436ba46-9c69-4204-a002-d5acf7c4d900 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109982024-11-02T04:11:27.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9436ba46-9c69-4204-a002-d5acf7c4d900 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
109992024-11-02T04:11:27.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9436ba46-9c69-4204-a002-d5acf7c4d900 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110002024-11-02T04:11:28.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3055ab15-a96a-4261-8daa-dd4a5db7f586 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110012024-11-02T04:11:28.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3055ab15-a96a-4261-8daa-dd4a5db7f586 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110022024-11-02T04:11:28.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3055ab15-a96a-4261-8daa-dd4a5db7f586 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110032024-11-02T04:11:28.912ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:65459
110042024-11-02T04:11:28.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3a642014-171f-42c7-b9df-caa28fb3c886 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
110052024-11-02T04:11:28.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3a642014-171f-42c7-b9df-caa28fb3c886 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
110062024-11-02T04:11:28.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3a642014-171f-42c7-b9df-caa28fb3c886 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?sort_by=id_ascending
110072024-11-02T04:11:28.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 8b941efa-6ed5-4158-8c8b-980487a6cd22 roles = RoleSet { roles: {} } uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
110082024-11-02T04:11:28.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 8b941efa-6ed5-4158-8c8b-980487a6cd22 resource = Database result = Ok(()) uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
110092024-11-02T04:11:28.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 8b941efa-6ed5-4158-8c8b-980487a6cd22 response_code = 200 uri = /metrics/collectors/3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkZjAxZjc5Yi0wNjgyLTRmMWItYWE5Ny0xYThiYjE4YjkxNTcifX0%3D
110102024-11-02T04:11:29.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 26ef59f8-5c07-4857-8bf9-1d8a85af14b6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110112024-11-02T04:11:29.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 26ef59f8-5c07-4857-8bf9-1d8a85af14b6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110122024-11-02T04:11:29.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 26ef59f8-5c07-4857-8bf9-1d8a85af14b6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110132024-11-02T04:11:30.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 27f309a0-9ec7-4fb8-8dd3-9cae58828190 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110142024-11-02T04:11:30.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 27f309a0-9ec7-4fb8-8dd3-9cae58828190 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110152024-11-02T04:11:30.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 27f309a0-9ec7-4fb8-8dd3-9cae58828190 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110162024-11-02T04:11:31.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 30141e01-a440-45db-9a83-b98e2fe5081c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110172024-11-02T04:11:31.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 30141e01-a440-45db-9a83-b98e2fe5081c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110182024-11-02T04:11:31.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 30141e01-a440-45db-9a83-b98e2fe5081c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110192024-11-02T04:11:32.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21b6ac2b-94b7-4cc6-8e8e-60cc18428688 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110202024-11-02T04:11:32.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21b6ac2b-94b7-4cc6-8e8e-60cc18428688 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110212024-11-02T04:11:32.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 21b6ac2b-94b7-4cc6-8e8e-60cc18428688 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110222024-11-02T04:11:33.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
110232024-11-02T04:11:33.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110242024-11-02T04:11:33.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
110252024-11-02T04:11:33.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110262024-11-02T04:11:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110272024-11-02T04:11:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110282024-11-02T04:11:33.547ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110292024-11-02T04:11:33.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110302024-11-02T04:11:33.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110312024-11-02T04:11:33.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.535856ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110322024-11-02T04:11:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110332024-11-02T04:11:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110342024-11-02T04:11:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110352024-11-02T04:11:33.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110362024-11-02T04:11:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110372024-11-02T04:11:33.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-11-02T04:11:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
110392024-11-02T04:11:33.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110402024-11-02T04:11:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110412024-11-02T04:11:33.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
110422024-11-02T04:11:33.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.369314ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
110432024-11-02T04:11:33.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f369b969-fc68-4810-9843-c1ad8eaf86bb roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110442024-11-02T04:11:33.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f369b969-fc68-4810-9843-c1ad8eaf86bb resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110452024-11-02T04:11:33.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f369b969-fc68-4810-9843-c1ad8eaf86bb response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110462024-11-02T04:11:34.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e16b706-88e8-44b5-95bb-fab937c4df3f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110472024-11-02T04:11:34.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e16b706-88e8-44b5-95bb-fab937c4df3f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110482024-11-02T04:11:34.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 2e16b706-88e8-44b5-95bb-fab937c4df3f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110492024-11-02T04:11:35.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 22552811-1c99-431f-8201-82620d1dad4f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110502024-11-02T04:11:35.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 22552811-1c99-431f-8201-82620d1dad4f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110512024-11-02T04:11:35.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 22552811-1c99-431f-8201-82620d1dad4f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110522024-11-02T04:11:36.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 41e54505-5a03-4a5d-bb55-d129d4283fcf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
110532024-11-02T04:11:36.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 41e54505-5a03-4a5d-bb55-d129d4283fcf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
110542024-11-02T04:11:36.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 41e54505-5a03-4a5d-bb55-d129d4283fcf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
110552024-11-02T04:11:36.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e2a0e7b8-612e-4e8f-aff7-534d6db790fa roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110562024-11-02T04:11:36.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e2a0e7b8-612e-4e8f-aff7-534d6db790fa resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110572024-11-02T04:11:36.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e2a0e7b8-612e-4e8f-aff7-534d6db790fa response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110582024-11-02T04:11:37.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 781444be-455b-4e6a-9ba4-da2f053a1428 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110592024-11-02T04:11:37.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 781444be-455b-4e6a-9ba4-da2f053a1428 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110602024-11-02T04:11:37.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 781444be-455b-4e6a-9ba4-da2f053a1428 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110612024-11-02T04:11:38.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6681d28-ba59-4f10-93ec-6df54d9ce705 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110622024-11-02T04:11:38.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6681d28-ba59-4f10-93ec-6df54d9ce705 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110632024-11-02T04:11:38.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6681d28-ba59-4f10-93ec-6df54d9ce705 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110642024-11-02T04:11:38.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1603 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 6b7a71d8-e180-4452-86b7-d670911bf51e response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
110652024-11-02T04:11:39.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fa44e90c-9618-4d1e-a006-465a91c4f6e6 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110662024-11-02T04:11:39.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fa44e90c-9618-4d1e-a006-465a91c4f6e6 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110672024-11-02T04:11:39.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = fa44e90c-9618-4d1e-a006-465a91c4f6e6 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110682024-11-02T04:11:40.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa1854fc-7331-4ac2-a9e5-776b566a4290 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110692024-11-02T04:11:40.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa1854fc-7331-4ac2-a9e5-776b566a4290 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110702024-11-02T04:11:40.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = aa1854fc-7331-4ac2-a9e5-776b566a4290 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110712024-11-02T04:11:41.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dcc91ed-2deb-4016-9053-c98feb1c4657 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110722024-11-02T04:11:41.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dcc91ed-2deb-4016-9053-c98feb1c4657 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110732024-11-02T04:11:41.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dcc91ed-2deb-4016-9053-c98feb1c4657 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110742024-11-02T04:11:43.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d18b1380-43f1-4178-aa89-5760ec6be287 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110752024-11-02T04:11:43.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d18b1380-43f1-4178-aa89-5760ec6be287 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110762024-11-02T04:11:43.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d18b1380-43f1-4178-aa89-5760ec6be287 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
110772024-11-02T04:11:43.544ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
110782024-11-02T04:11:43.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110792024-11-02T04:11:43.544ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
110802024-11-02T04:11:43.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
110812024-11-02T04:11:43.544ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110822024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110832024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
110842024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
110852024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110862024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
110872024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110882024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110892024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
110902024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110912024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110922024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
110932024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110942024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
110952024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110962024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
110972024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110982024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
110992024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111002024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
111012024-11-02T04:11:43.545ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
111022024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111032024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
111042024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111052024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111062024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111072024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111082024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111092024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111102024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111112024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111122024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111132024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111142024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111152024-11-02T04:11:43.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111162024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
111172024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.041\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
111182024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
111192024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
111202024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.82\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
111212024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.01\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
111222024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
111232024-11-02T04:11:43.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.41\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111242024-11-02T04:11:43.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111252024-11-02T04:11:43.552ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111262024-11-02T04:11:43.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10207, tv_nsec: 525985979 } })
111272024-11-02T04:11:43.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111282024-11-02T04:11:43.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
111292024-11-02T04:11:43.553ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.125455ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111302024-11-02T04:11:43.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111312024-11-02T04:11:43.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10207, tv_nsec: 527060972 } })
111322024-11-02T04:11:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111332024-11-02T04:11:43.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111342024-11-02T04:11:43.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
111352024-11-02T04:11:43.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111362024-11-02T04:11:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111372024-11-02T04:11:43.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111382024-11-02T04:11:43.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111392024-11-02T04:11:43.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111402024-11-02T04:11:43.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111412024-11-02T04:11:43.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111422024-11-02T04:11:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111432024-11-02T04:11:43.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111442024-11-02T04:11:43.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111452024-11-02T04:11:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111462024-11-02T04:11:43.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-11-02T04:11:43.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111482024-11-02T04:11:43.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111492024-11-02T04:11:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111502024-11-02T04:11:43.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111512024-11-02T04:11:43.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111522024-11-02T04:11:43.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111532024-11-02T04:11:43.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111542024-11-02T04:11:43.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111552024-11-02T04:11:43.562ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111562024-11-02T04:11:43.562ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111572024-11-02T04:11:43.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111582024-11-02T04:11:43.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111592024-11-02T04:11:43.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10207, tv_nsec: 536232619 } })
111602024-11-02T04:11:43.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
111612024-11-02T04:11:43.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111622024-11-02T04:11:43.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111632024-11-02T04:11:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111642024-11-02T04:11:43.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111652024-11-02T04:11:43.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111662024-11-02T04:11:43.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111672024-11-02T04:11:43.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111682024-11-02T04:11:43.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111692024-11-02T04:11:43.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111702024-11-02T04:11:43.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111712024-11-02T04:11:43.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111722024-11-02T04:11:43.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111732024-11-02T04:11:43.572ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111742024-11-02T04:11:43.572ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.057101ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111752024-11-02T04:11:43.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111762024-11-02T04:11:43.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111772024-11-02T04:11:43.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111782024-11-02T04:11:43.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111792024-11-02T04:11:43.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111802024-11-02T04:11:43.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
111812024-11-02T04:11:43.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111822024-11-02T04:11:43.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111832024-11-02T04:11:43.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111842024-11-02T04:11:43.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111852024-11-02T04:11:43.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111862024-11-02T04:11:43.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111872024-11-02T04:11:43.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111882024-11-02T04:11:43.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111892024-11-02T04:11:43.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.471059ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111902024-11-02T04:11:43.601ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111912024-11-02T04:11:43.601ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111922024-11-02T04:11:43.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111932024-11-02T04:11:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111942024-11-02T04:11:43.640ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
111952024-11-02T04:11:43.640ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111962024-11-02T04:11:43.640ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa233874-5509-45c9-a68c-a7da1a15ec30", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
111972024-11-02T04:11:43.640ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111982024-11-02T04:11:43.642ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111992024-11-02T04:11:43.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
112002024-11-02T04:11:43.724ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112012024-11-02T04:11:43.724ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f4e73ec-3d46-4abd-a8e4-7776f14fc6af", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112022024-11-02T04:11:43.724ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112032024-11-02T04:11:43.726ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112042024-11-02T04:11:43.748ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112052024-11-02T04:11:43.748ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112062024-11-02T04:11:43.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112072024-11-02T04:11:43.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112082024-11-02T04:11:43.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112092024-11-02T04:11:43.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112102024-11-02T04:11:43.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112112024-11-02T04:11:43.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112122024-11-02T04:11:43.761ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
112132024-11-02T04:11:43.761ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 216.200443ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
112142024-11-02T04:11:43.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
112152024-11-02T04:11:43.763ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112162024-11-02T04:11:43.763ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fabeedd-ab6c-48a0-857b-a5fcac1ef46f", "content-length": "26", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112172024-11-02T04:11:43.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112182024-11-02T04:11:43.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
112192024-11-02T04:11:43.786ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112202024-11-02T04:11:43.786ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112212024-11-02T04:11:43.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 241.924546ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112222024-11-02T04:11:43.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112232024-11-02T04:11:43.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 247.406013ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112242024-11-02T04:11:43.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112252024-11-02T04:11:43.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112262024-11-02T04:11:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112272024-11-02T04:11:43.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112282024-11-02T04:11:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
112292024-11-02T04:11:43.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112302024-11-02T04:11:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112312024-11-02T04:11:43.798ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 253.129846ms iteration = 30 status = 0
112322024-11-02T04:11:43.804ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 259.315559ms iteration = 30 status = {}
112332024-11-02T04:11:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 307.225427ms iteration = 34 status = {"physical_disks_added":0}
112342024-11-02T04:11:43.865ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112352024-11-02T04:11:43.865ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "32a41416-302a-4cc5-b59d-e76dcb4c6072", "content-length": "2", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112362024-11-02T04:11:43.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe3ccd9d-f4de-498f-b007-d946d8f47808", "content-length": "372", "date": "Sat, 02 Nov 2024 04:11:42 GMT"} })
112372024-11-02T04:11:43.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112382024-11-02T04:11:43.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112392024-11-02T04:11:43.868ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112402024-11-02T04:11:43.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112412024-11-02T04:11:43.912ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112422024-11-02T04:11:43.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "26da5f5f-56cc-4c73-98e7-176de892aed4", "content-length": "691", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112432024-11-02T04:11:43.913ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
112442024-11-02T04:11:43.913ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
112452024-11-02T04:11:43.913ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
112462024-11-02T04:11:43.913ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
112472024-11-02T04:11:43.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112482024-11-02T04:11:43.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a11b8343-abba-47b0-9f84-e32958ed32a6", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112492024-11-02T04:11:43.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112502024-11-02T04:11:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112512024-11-02T04:11:43.914ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 369.895684ms iteration = 31 status = {}
112522024-11-02T04:11:43.915ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.105999ms iteration = 30 status = null
112532024-11-02T04:11:43.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112542024-11-02T04:11:43.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112552024-11-02T04:11:43.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112562024-11-02T04:11:43.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112572024-11-02T04:11:43.922ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112582024-11-02T04:11:43.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112592024-11-02T04:11:43.923ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6b19cd87-5641-4d8a-8ba2-30522f360653", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112602024-11-02T04:11:43.925ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.340878ms iteration = 32 status = {}
112612024-11-02T04:11:43.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112622024-11-02T04:11:43.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112632024-11-02T04:11:43.964ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
112642024-11-02T04:11:43.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112652024-11-02T04:11:43.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112662024-11-02T04:11:43.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112672024-11-02T04:11:43.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf2c08c-4a31-4192-8b3c-0c23aefcb64f", "content-length": "134", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112682024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112692024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
112702024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112712024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112722024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112732024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112742024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112752024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112762024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112772024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112782024-11-02T04:11:43.975ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
112792024-11-02T04:11:43.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112802024-11-02T04:11:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112812024-11-02T04:11:43.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112822024-11-02T04:11:43.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf75a164-7477-4fd1-8fa2-2206369442b9", "content-length": "2", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112832024-11-02T04:11:43.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112842024-11-02T04:11:43.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1cac22-dbe2-4d6b-88c9-387738aa36d9", "content-length": "52", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112852024-11-02T04:11:43.977ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
112862024-11-02T04:11:43.977ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112872024-11-02T04:11:44.094ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1159ef74-2486-4bb8-9284-06fdd11d6d47", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112882024-11-02T04:11:44.094ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
112892024-11-02T04:11:44.094ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112902024-11-02T04:11:44.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e08f51db-d8e3-4c68-b17c-fa4437024d4b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
112912024-11-02T04:11:44.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e08f51db-d8e3-4c68-b17c-fa4437024d4b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
112922024-11-02T04:11:44.094ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd8c8a6-2804-4752-b3fa-f7bf528d28b1", "content-length": "682", "date": "Sat, 02 Nov 2024 04:11:43 GMT"} })
112932024-11-02T04:11:44.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112942024-11-02T04:11:44.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112952024-11-02T04:11:44.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e08f51db-d8e3-4c68-b17c-fa4437024d4b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
112962024-11-02T04:11:44.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112972024-11-02T04:11:44.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112982024-11-02T04:11:44.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112992024-11-02T04:11:44.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113002024-11-02T04:11:44.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113012024-11-02T04:11:44.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113022024-11-02T04:11:44.112ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 567.985727ms iteration = 30 status = {}
113032024-11-02T04:11:45.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f63cfa95-fb38-4034-b2e2-683f3784b7f3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113042024-11-02T04:11:45.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f63cfa95-fb38-4034-b2e2-683f3784b7f3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113052024-11-02T04:11:45.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f63cfa95-fb38-4034-b2e2-683f3784b7f3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113062024-11-02T04:11:46.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7284f61c-97af-452d-b2ef-8314391f6178 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113072024-11-02T04:11:46.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7284f61c-97af-452d-b2ef-8314391f6178 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113082024-11-02T04:11:46.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7284f61c-97af-452d-b2ef-8314391f6178 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113092024-11-02T04:11:47.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ce486cc-428e-4d65-85be-3f5993905402 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113102024-11-02T04:11:47.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ce486cc-428e-4d65-85be-3f5993905402 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113112024-11-02T04:11:47.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7ce486cc-428e-4d65-85be-3f5993905402 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113122024-11-02T04:11:48.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4f89a14-fcc7-492b-a70d-eb3b77c44045 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113132024-11-02T04:11:48.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4f89a14-fcc7-492b-a70d-eb3b77c44045 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113142024-11-02T04:11:48.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c4f89a14-fcc7-492b-a70d-eb3b77c44045 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113152024-11-02T04:11:49.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dd98b32-4695-47c3-81f5-70d791b1bb7b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113162024-11-02T04:11:49.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dd98b32-4695-47c3-81f5-70d791b1bb7b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113172024-11-02T04:11:49.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3dd98b32-4695-47c3-81f5-70d791b1bb7b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113182024-11-02T04:11:50.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 620c8634-e4f5-4656-87aa-fbdcd85bdb9e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113192024-11-02T04:11:50.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 620c8634-e4f5-4656-87aa-fbdcd85bdb9e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113202024-11-02T04:11:50.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 620c8634-e4f5-4656-87aa-fbdcd85bdb9e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113212024-11-02T04:11:51.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e88645c-3f58-4b2e-b867-893a1e8a64d1 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113222024-11-02T04:11:51.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e88645c-3f58-4b2e-b867-893a1e8a64d1 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113232024-11-02T04:11:51.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9e88645c-3f58-4b2e-b867-893a1e8a64d1 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113242024-11-02T04:11:52.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65725342-1b7a-4c89-87c1-c5ab355f8ebc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113252024-11-02T04:11:52.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65725342-1b7a-4c89-87c1-c5ab355f8ebc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113262024-11-02T04:11:52.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 65725342-1b7a-4c89-87c1-c5ab355f8ebc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113272024-11-02T04:11:53.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8aabbb-274f-4652-9c19-a3e3ca185903 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113282024-11-02T04:11:53.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8aabbb-274f-4652-9c19-a3e3ca185903 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113292024-11-02T04:11:53.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ff8aabbb-274f-4652-9c19-a3e3ca185903 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113302024-11-02T04:11:53.544ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
113312024-11-02T04:11:53.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113322024-11-02T04:11:53.544ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
113332024-11-02T04:11:53.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113342024-11-02T04:11:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113352024-11-02T04:11:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113362024-11-02T04:11:53.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113372024-11-02T04:11:53.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113382024-11-02T04:11:53.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113392024-11-02T04:11:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113402024-11-02T04:11:53.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113412024-11-02T04:11:53.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113422024-11-02T04:11:53.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113432024-11-02T04:11:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
113442024-11-02T04:11:53.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113452024-11-02T04:11:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113462024-11-02T04:11:53.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
113472024-11-02T04:11:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.657872ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
113482024-11-02T04:11:53.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113492024-11-02T04:11:53.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113502024-11-02T04:11:53.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.989518ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113512024-11-02T04:11:53.919ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1327 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = aa9bb8e3-8a48-44b0-a7c4-f43efccefbdb response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
113522024-11-02T04:11:54.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4465cc2-e596-4b5b-bd88-728c23e74457 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113532024-11-02T04:11:54.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4465cc2-e596-4b5b-bd88-728c23e74457 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113542024-11-02T04:11:54.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4465cc2-e596-4b5b-bd88-728c23e74457 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113552024-11-02T04:11:55.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 904c11c3-b8ad-479f-a3e4-7c5c283e8e81 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113562024-11-02T04:11:55.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 904c11c3-b8ad-479f-a3e4-7c5c283e8e81 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113572024-11-02T04:11:55.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 904c11c3-b8ad-479f-a3e4-7c5c283e8e81 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113582024-11-02T04:11:56.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a3c627f1-ec09-4650-92e6-6fe62c87a92c roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113592024-11-02T04:11:56.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a3c627f1-ec09-4650-92e6-6fe62c87a92c resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113602024-11-02T04:11:56.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a3c627f1-ec09-4650-92e6-6fe62c87a92c response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113612024-11-02T04:11:57.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73744ad-6f26-4f84-8b3a-770ca39f0cd9 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113622024-11-02T04:11:57.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73744ad-6f26-4f84-8b3a-770ca39f0cd9 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113632024-11-02T04:11:57.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f73744ad-6f26-4f84-8b3a-770ca39f0cd9 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113642024-11-02T04:11:58.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e236ba59-3a1e-48c3-b2a9-785b3f0dcc36 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113652024-11-02T04:11:58.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e236ba59-3a1e-48c3-b2a9-785b3f0dcc36 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113662024-11-02T04:11:58.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e236ba59-3a1e-48c3-b2a9-785b3f0dcc36 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113672024-11-02T04:11:59.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1b44a25e-e028-4fd5-9e74-ff4805571be4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113682024-11-02T04:11:59.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1b44a25e-e028-4fd5-9e74-ff4805571be4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113692024-11-02T04:11:59.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1b44a25e-e028-4fd5-9e74-ff4805571be4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113702024-11-02T04:12:00.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 200e0e25-bc2d-47b9-89fd-b4a67257ad95 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113712024-11-02T04:12:00.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 200e0e25-bc2d-47b9-89fd-b4a67257ad95 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113722024-11-02T04:12:00.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 200e0e25-bc2d-47b9-89fd-b4a67257ad95 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113732024-11-02T04:12:01.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8234322-3854-4c1a-aef9-22fbacdaf279 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113742024-11-02T04:12:01.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8234322-3854-4c1a-aef9-22fbacdaf279 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113752024-11-02T04:12:01.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a8234322-3854-4c1a-aef9-22fbacdaf279 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113762024-11-02T04:12:02.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59083f7c-b9f5-464f-be05-51fbde2eeb42 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113772024-11-02T04:12:02.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59083f7c-b9f5-464f-be05-51fbde2eeb42 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113782024-11-02T04:12:02.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 59083f7c-b9f5-464f-be05-51fbde2eeb42 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113792024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
113802024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113812024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
113822024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113832024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113842024-11-02T04:12:03.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113852024-11-02T04:12:03.547ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113862024-11-02T04:12:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113872024-11-02T04:12:03.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113882024-11-02T04:12:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113892024-11-02T04:12:03.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113902024-11-02T04:12:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113912024-11-02T04:12:03.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113922024-11-02T04:12:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113932024-11-02T04:12:03.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4267c7d-05f5-4577-8f0a-d14cdd6e0552 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113942024-11-02T04:12:03.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4267c7d-05f5-4577-8f0a-d14cdd6e0552 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113952024-11-02T04:12:03.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a4267c7d-05f5-4577-8f0a-d14cdd6e0552 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
113962024-11-02T04:12:03.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.216743ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113972024-11-02T04:12:03.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113982024-11-02T04:12:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
113992024-11-02T04:12:03.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114002024-11-02T04:12:03.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114012024-11-02T04:12:03.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
114022024-11-02T04:12:03.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.323711ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
114032024-11-02T04:12:04.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdfee9f-a661-4302-889d-ab07c7581aa2 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114042024-11-02T04:12:04.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdfee9f-a661-4302-889d-ab07c7581aa2 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114052024-11-02T04:12:04.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9fdfee9f-a661-4302-889d-ab07c7581aa2 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114062024-11-02T04:12:05.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a06b5e43-3560-47e3-a19a-e43e69698839 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114072024-11-02T04:12:05.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a06b5e43-3560-47e3-a19a-e43e69698839 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114082024-11-02T04:12:05.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a06b5e43-3560-47e3-a19a-e43e69698839 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114092024-11-02T04:12:06.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 042dfb6f-4818-4f6d-ac7b-840f47bf374f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114102024-11-02T04:12:06.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 042dfb6f-4818-4f6d-ac7b-840f47bf374f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114112024-11-02T04:12:06.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 042dfb6f-4818-4f6d-ac7b-840f47bf374f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114122024-11-02T04:12:06.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 7ab5da1a-194d-4a29-9802-9446c017975a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
114132024-11-02T04:12:06.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 7ab5da1a-194d-4a29-9802-9446c017975a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
114142024-11-02T04:12:06.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 7ab5da1a-194d-4a29-9802-9446c017975a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
114152024-11-02T04:12:07.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 86b3de97-fbf2-4c06-958f-7437b3519b0b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114162024-11-02T04:12:07.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 86b3de97-fbf2-4c06-958f-7437b3519b0b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114172024-11-02T04:12:07.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 86b3de97-fbf2-4c06-958f-7437b3519b0b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114182024-11-02T04:12:08.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83cfefc0-e224-465b-80cb-499aa3175b11 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114192024-11-02T04:12:08.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83cfefc0-e224-465b-80cb-499aa3175b11 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114202024-11-02T04:12:08.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 83cfefc0-e224-465b-80cb-499aa3175b11 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114212024-11-02T04:12:08.920ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1684 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = aa527371-7293-42c0-b325-0a521fe08ab0 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
114222024-11-02T04:12:09.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6b58dd9-d92c-4992-bd17-a0c1037ad2ee roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114232024-11-02T04:12:09.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6b58dd9-d92c-4992-bd17-a0c1037ad2ee resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114242024-11-02T04:12:09.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d6b58dd9-d92c-4992-bd17-a0c1037ad2ee response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114252024-11-02T04:12:10.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f52a989-edf4-4d51-9b63-77e7c3ced9e4 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114262024-11-02T04:12:10.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f52a989-edf4-4d51-9b63-77e7c3ced9e4 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114272024-11-02T04:12:10.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 7f52a989-edf4-4d51-9b63-77e7c3ced9e4 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114282024-11-02T04:12:11.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfa2e559-6aef-4e6f-8310-602076ebad00 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114292024-11-02T04:12:11.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfa2e559-6aef-4e6f-8310-602076ebad00 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114302024-11-02T04:12:11.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = cfa2e559-6aef-4e6f-8310-602076ebad00 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114312024-11-02T04:12:12.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3be6d71-028e-4d6a-b5f8-aff822efe596 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114322024-11-02T04:12:12.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3be6d71-028e-4d6a-b5f8-aff822efe596 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114332024-11-02T04:12:12.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b3be6d71-028e-4d6a-b5f8-aff822efe596 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
114342024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
114352024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114362024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
114372024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114382024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
114392024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
114402024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
114412024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114422024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
114432024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114442024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114452024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
114462024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
114472024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114482024-11-02T04:12:13.545ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
114492024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114502024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
114512024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114522024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
114532024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
114542024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114552024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
114562024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114572024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
114582024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
114592024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
114602024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114612024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
114622024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
114632024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114642024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
114652024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
114662024-11-02T04:12:13.545ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114672024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
114682024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114692024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
114702024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114712024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
114722024-11-02T04:12:13.545ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = cac56846-ee51-402c-96d1-00442596b57c
114732024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.7\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"cac56846-ee51-402c-96d1-00442596b57c"}
114742024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
114752024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
114762024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
114772024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114782024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
114792024-11-02T04:12:13.545ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 04:02:13.545424288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
114802024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
114812024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
114822024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
114832024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
114842024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114852024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
114862024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
114872024-11-02T04:12:13.545ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
114882024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114892024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114902024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
114912024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.2\u{b5}s iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
114922024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
114932024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
114942024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
114952024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
114962024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.891\u{b5}s iteration = 31 status = {"errors":[],"records_set_to_done":[]}
114972024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
114982024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
114992024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
115002024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.37\u{b5}s iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
115012024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.94\u{b5}s iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
115022024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115032024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115042024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115052024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115062024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115072024-11-02T04:12:13.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115082024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115092024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115102024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115112024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115122024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115132024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115142024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115152024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115162024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115172024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115182024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115192024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115202024-11-02T04:12:13.546ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c3f42f2-ce05-428f-a91a-f78ae70ccccf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1a7f019f-e208-4fae-b98e-fe6120f9b5e2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2c96eacb-1841-4277-9578-6b84caeef9c6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 10237, tv_nsec: 519392047 } })
115212024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
115222024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
115232024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
115242024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
115252024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115262024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115272024-11-02T04:12:13.546ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f79c18f-7b53-4b8a-86fc-bb23b923ea1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 10237, tv_nsec: 519514749 } })
115282024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115292024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115302024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115312024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115322024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
115332024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.121855ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
115342024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
115352024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.294137ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
115362024-11-02T04:12:13.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115372024-11-02T04:12:13.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115382024-11-02T04:12:13.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115392024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.703869ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115402024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115412024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115422024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115432024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115442024-11-02T04:12:13.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10237, tv_nsec: 523206739 } })
115452024-11-02T04:12:13.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10237, tv_nsec: 523333351 } })
115462024-11-02T04:12:13.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115472024-11-02T04:12:13.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
115482024-11-02T04:12:13.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
115492024-11-02T04:12:13.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115502024-11-02T04:12:13.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
115512024-11-02T04:12:13.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115522024-11-02T04:12:13.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115532024-11-02T04:12:13.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115542024-11-02T04:12:13.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115552024-11-02T04:12:13.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115562024-11-02T04:12:13.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115572024-11-02T04:12:13.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115582024-11-02T04:12:13.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115592024-11-02T04:12:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115602024-11-02T04:12:13.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115612024-11-02T04:12:13.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115622024-11-02T04:12:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115632024-11-02T04:12:13.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115642024-11-02T04:12:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115652024-11-02T04:12:13.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115662024-11-02T04:12:13.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115672024-11-02T04:12:13.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115682024-11-02T04:12:13.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115692024-11-02T04:12:13.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115702024-11-02T04:12:13.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115712024-11-02T04:12:13.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115722024-11-02T04:12:13.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115732024-11-02T04:12:13.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115742024-11-02T04:12:13.566ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 04:02:13.545424288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
115752024-11-02T04:12:13.566ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.635103ms iteration = 16 status = {"expiration":"2024-11-02T04:02:13.545424288Z","pruned":[]}
115762024-11-02T04:12:13.566ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.51052ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
115772024-11-02T04:12:13.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115782024-11-02T04:12:13.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
115792024-11-02T04:12:13.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115802024-11-02T04:12:13.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115812024-11-02T04:12:13.574ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115822024-11-02T04:12:13.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5b8cdd5a-f021-45f2-8323-b6c8f9776060.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 10237, tv_nsec: 546760925 } })
115832024-11-02T04:12:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115842024-11-02T04:12:13.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115852024-11-02T04:12:13.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115862024-11-02T04:12:13.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
115872024-11-02T04:12:13.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115882024-11-02T04:12:13.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115892024-11-02T04:12:13.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115902024-11-02T04:12:13.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115912024-11-02T04:12:13.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115922024-11-02T04:12:13.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
115932024-11-02T04:12:13.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115942024-11-02T04:12:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115952024-11-02T04:12:13.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115962024-11-02T04:12:13.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115972024-11-02T04:12:13.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115982024-11-02T04:12:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115992024-11-02T04:12:13.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116002024-11-02T04:12:13.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116012024-11-02T04:12:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
116022024-11-02T04:12:13.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116032024-11-02T04:12:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116042024-11-02T04:12:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
116052024-11-02T04:12:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116062024-11-02T04:12:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116072024-11-02T04:12:13.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116082024-11-02T04:12:13.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116092024-11-02T04:12:13.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116102024-11-02T04:12:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116112024-11-02T04:12:13.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116122024-11-02T04:12:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116132024-11-02T04:12:13.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116142024-11-02T04:12:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116152024-11-02T04:12:13.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116162024-11-02T04:12:13.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116172024-11-02T04:12:13.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116182024-11-02T04:12:13.614ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
116192024-11-02T04:12:13.615ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
116202024-11-02T04:12:13.615ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.427751ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
116212024-11-02T04:12:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
116222024-11-02T04:12:13.615ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116232024-11-02T04:12:13.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116242024-11-02T04:12:13.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116252024-11-02T04:12:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116262024-11-02T04:12:13.616ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116272024-11-02T04:12:13.616ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116282024-11-02T04:12:13.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116292024-11-02T04:12:13.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116302024-11-02T04:12:13.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116312024-11-02T04:12:13.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116322024-11-02T04:12:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.419698ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116332024-11-02T04:12:13.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116342024-11-02T04:12:13.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116352024-11-02T04:12:13.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.855844ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116362024-11-02T04:12:13.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116372024-11-02T04:12:13.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116382024-11-02T04:12:13.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116392024-11-02T04:12:13.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116402024-11-02T04:12:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116412024-11-02T04:12:13.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116422024-11-02T04:12:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
116432024-11-02T04:12:13.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116442024-11-02T04:12:13.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116452024-11-02T04:12:13.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116462024-11-02T04:12:13.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116472024-11-02T04:12:13.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116482024-11-02T04:12:13.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116492024-11-02T04:12:13.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116502024-11-02T04:12:13.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116512024-11-02T04:12:13.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116522024-11-02T04:12:13.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116532024-11-02T04:12:13.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116542024-11-02T04:12:13.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116552024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
116562024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.505511ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
116572024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116582024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116592024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116602024-11-02T04:12:13.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116612024-11-02T04:12:13.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116622024-11-02T04:12:13.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
116632024-11-02T04:12:13.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116642024-11-02T04:12:13.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116652024-11-02T04:12:13.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116662024-11-02T04:12:13.637ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 92.310892ms iteration = 7 status = {"nsuccess":5}
116672024-11-02T04:12:13.637ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
116682024-11-02T04:12:13.637ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
116692024-11-02T04:12:13.637ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
116702024-11-02T04:12:13.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116712024-11-02T04:12:13.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116722024-11-02T04:12:13.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116732024-11-02T04:12:13.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116742024-11-02T04:12:13.641ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116752024-11-02T04:12:13.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116762024-11-02T04:12:13.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.558354ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116772024-11-02T04:12:13.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116782024-11-02T04:12:13.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116792024-11-02T04:12:13.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116802024-11-02T04:12:13.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116812024-11-02T04:12:13.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116822024-11-02T04:12:13.647ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
116832024-11-02T04:12:13.647ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 0 version = 2
116842024-11-02T04:12:13.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116852024-11-02T04:12:13.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116862024-11-02T04:12:13.650ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
116872024-11-02T04:12:13.650ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
116882024-11-02T04:12:13.650ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.75136ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
116892024-11-02T04:12:13.654ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116902024-11-02T04:12:13.654ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116912024-11-02T04:12:13.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.770777ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116922024-11-02T04:12:13.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
116932024-11-02T04:12:13.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
116942024-11-02T04:12:13.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116952024-11-02T04:12:13.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116962024-11-02T04:12:13.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116972024-11-02T04:12:13.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
116982024-11-02T04:12:13.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116992024-11-02T04:12:13.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117002024-11-02T04:12:13.672ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117012024-11-02T04:12:13.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117022024-11-02T04:12:13.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
117032024-11-02T04:12:13.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
117042024-11-02T04:12:13.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
117052024-11-02T04:12:13.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117062024-11-02T04:12:13.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117072024-11-02T04:12:13.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117082024-11-02T04:12:13.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
117092024-11-02T04:12:13.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117102024-11-02T04:12:13.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117112024-11-02T04:12:13.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117122024-11-02T04:12:13.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117132024-11-02T04:12:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117142024-11-02T04:12:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117152024-11-02T04:12:13.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117162024-11-02T04:12:13.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117172024-11-02T04:12:13.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117182024-11-02T04:12:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117192024-11-02T04:12:13.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117202024-11-02T04:12:13.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117212024-11-02T04:12:13.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
117222024-11-02T04:12:13.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117232024-11-02T04:12:13.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117242024-11-02T04:12:13.690ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 144.862431ms iteration = 31 status = 0
117252024-11-02T04:12:13.690ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f7c2e80b-f251-402b-8950-aea1ba76cb66 dns_zone_name = oxide.test found_so_far = 1 version = 2
117262024-11-02T04:12:13.690ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
117272024-11-02T04:12:13.690ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 03:57:55.531930 UTC dns_group = external generation = 2
117282024-11-02T04:12:13.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 144.975744ms iteration = 17 status = {"generation":2}
117292024-11-02T04:12:13.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117302024-11-02T04:12:13.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117312024-11-02T04:12:13.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117322024-11-02T04:12:13.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117332024-11-02T04:12:13.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117342024-11-02T04:12:13.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117352024-11-02T04:12:13.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
117362024-11-02T04:12:13.697ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117372024-11-02T04:12:13.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117382024-11-02T04:12:13.698ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88dd276e-9458-4e63-bd7d-1659b07f093c", "content-length": "26", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
117392024-11-02T04:12:13.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117402024-11-02T04:12:13.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117412024-11-02T04:12:13.698ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
117422024-11-02T04:12:13.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
117432024-11-02T04:12:13.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117442024-11-02T04:12:13.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117452024-11-02T04:12:13.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117462024-11-02T04:12:13.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117472024-11-02T04:12:13.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117482024-11-02T04:12:13.710ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T03:57:11.437053Z, time_modified: 2024-11-02T03:57:11.437053Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, db_silo: Silo { identity: SiloIdentity { id: 73ce13ac-7ea3-466e-9d78-11e4419419eb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T03:57:55.487602Z, time_modified: 2024-11-02T03:57:55.487602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf" }] }) }
117492024-11-02T04:12:13.710ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 165.253469ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]}},"default_endpoint":{"silo_id":"73ce13ac-7ea3-466e-9d78-11e4419419eb","tls_certs":["88c0499afc259c150e3e769c45e0a3e369a97f6b64f140a2963021e3876d5ebf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
117502024-11-02T04:12:13.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117512024-11-02T04:12:13.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117522024-11-02T04:12:13.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117532024-11-02T04:12:13.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117542024-11-02T04:12:13.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117552024-11-02T04:12:13.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117562024-11-02T04:12:13.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117572024-11-02T04:12:13.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117582024-11-02T04:12:13.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117592024-11-02T04:12:13.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
117602024-11-02T04:12:13.718ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117612024-11-02T04:12:13.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c0ce61-3656-41ae-850b-3f61e5c7057b", "content-length": "26", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
117622024-11-02T04:12:13.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117632024-11-02T04:12:13.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
117642024-11-02T04:12:13.734ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
117652024-11-02T04:12:13.734ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
117662024-11-02T04:12:13.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117672024-11-02T04:12:13.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117682024-11-02T04:12:13.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 zone_address = fd00:1122:3344:101::2
117692024-11-02T04:12:13.742ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117702024-11-02T04:12:13.742ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d29726e-2ab2-4568-9988-d8f8eb33be3f", "content-length": "26", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
117712024-11-02T04:12:13.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117722024-11-02T04:12:13.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e190f004-2376-4aae-8296-5a5757dc1123
117732024-11-02T04:12:13.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117742024-11-02T04:12:13.761ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.017249ms iteration = 35 status = {"physical_disks_added":0}
117752024-11-02T04:12:13.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117762024-11-02T04:12:13.763ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
117772024-11-02T04:12:13.763ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 218.285128ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
117782024-11-02T04:12:13.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b05c9ad9-bf61-42c4-8c4c-a5d5bbcc9c7a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
117792024-11-02T04:12:13.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b05c9ad9-bf61-42c4-8c4c-a5d5bbcc9c7a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
117802024-11-02T04:12:13.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
117812024-11-02T04:12:13.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "02c82547-1225-4980-8882-65f291938ec3", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
117822024-11-02T04:12:13.827ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
117832024-11-02T04:12:13.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4176b20d-0c97-42e8-8bda-c17bb2b8108c", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
117842024-11-02T04:12:13.829ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
117852024-11-02T04:12:13.831ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
117862024-11-02T04:12:13.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 285.684776ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
117872024-11-02T04:12:13.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.666074ms iteration = 31 status = {}
117882024-11-02T04:12:13.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
117892024-11-02T04:12:13.885ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
117902024-11-02T04:12:13.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7802ca2c-b264-4f89-915e-915e92441bcf", "content-length": "2", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
117912024-11-02T04:12:13.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117922024-11-02T04:12:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117932024-11-02T04:12:13.958ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
117942024-11-02T04:12:13.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
117952024-11-02T04:12:13.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a77f4a33-74c5-43d9-9c53-41c2b0362a38", "content-length": "372", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
117962024-11-02T04:12:13.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117972024-11-02T04:12:13.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117982024-11-02T04:12:13.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117992024-11-02T04:12:13.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118002024-11-02T04:12:13.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118012024-11-02T04:12:13.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022024-11-02T04:12:13.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b05c9ad9-bf61-42c4-8c4c-a5d5bbcc9c7a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
118032024-11-02T04:12:13.962ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.855354ms iteration = 31 status = null
118042024-11-02T04:12:13.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118052024-11-02T04:12:13.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118062024-11-02T04:12:13.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118072024-11-02T04:12:13.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118082024-11-02T04:12:13.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118092024-11-02T04:12:13.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118102024-11-02T04:12:13.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118112024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118122024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118132024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 64ce9290-e009-4241-a091-f84d9a5061d8 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
118142024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
118152024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 03:57:54.826111 UTC dns_group = internal generation = 1
118162024-11-02T04:12:13.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 422.426272ms iteration = 17 status = {"generation":1}
118172024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118182024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118192024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
118202024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118212024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118222024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118232024-11-02T04:12:13.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "161bb8f6-b6f2-4741-b7e3-ff652c9ecb4e", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118242024-11-02T04:12:13.968ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118252024-11-02T04:12:13.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118262024-11-02T04:12:13.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118272024-11-02T04:12:13.971ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d7cacbed-0453-4337-ba07-89b9e92b376b", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118282024-11-02T04:12:13.971ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118292024-11-02T04:12:13.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118302024-11-02T04:12:13.973ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "31ae8888-a749-459a-8938-e4d4f5d83977", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118312024-11-02T04:12:13.973ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118322024-11-02T04:12:13.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
118332024-11-02T04:12:13.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118342024-11-02T04:12:13.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118352024-11-02T04:12:13.975ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
118362024-11-02T04:12:13.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 430.663169ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
118372024-11-02T04:12:13.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118382024-11-02T04:12:13.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118392024-11-02T04:12:13.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118402024-11-02T04:12:13.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118412024-11-02T04:12:14.002ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118422024-11-02T04:12:14.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118432024-11-02T04:12:14.008ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118442024-11-02T04:12:14.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118452024-11-02T04:12:14.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
118462024-11-02T04:12:14.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118472024-11-02T04:12:14.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118482024-11-02T04:12:14.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118492024-11-02T04:12:14.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118502024-11-02T04:12:14.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118512024-11-02T04:12:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118522024-11-02T04:12:14.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118532024-11-02T04:12:14.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118542024-11-02T04:12:14.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118552024-11-02T04:12:14.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118562024-11-02T04:12:14.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118572024-11-02T04:12:14.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118582024-11-02T04:12:14.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118592024-11-02T04:12:14.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118602024-11-02T04:12:14.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118612024-11-02T04:12:14.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118622024-11-02T04:12:14.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118632024-11-02T04:12:14.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118642024-11-02T04:12:14.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118652024-11-02T04:12:14.041ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 31fead59-7d36-4cdb-8eb2-52038985d8f2, rack_id: e190f004-2376-4aae-8296-5a5757dc1123, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0) } rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
118662024-11-02T04:12:14.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118672024-11-02T04:12:14.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
118682024-11-02T04:12:14.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118692024-11-02T04:12:14.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118702024-11-02T04:12:14.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118712024-11-02T04:12:14.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118722024-11-02T04:12:14.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118732024-11-02T04:12:14.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118742024-11-02T04:12:14.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118752024-11-02T04:12:14.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118762024-11-02T04:12:14.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
118772024-11-02T04:12:14.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118782024-11-02T04:12:14.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118792024-11-02T04:12:14.054ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
118802024-11-02T04:12:14.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7325221e-168a-4374-9012-731f9efe1740", "content-length": "134", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
118812024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
118822024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e7fcd8c4-07e1-44f7-ae3c-800b1a3c7fa0
118832024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
118842024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
118852024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118862024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118872024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118882024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118892024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118902024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118912024-11-02T04:12:14.055ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e190f004-2376-4aae-8296-5a5757dc1123
118922024-11-02T04:12:14.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118932024-11-02T04:12:14.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118942024-11-02T04:12:14.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
118952024-11-02T04:12:14.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc85ff2-e6e2-47b5-b335-ab05c7cae0b7", "content-length": "2", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
118962024-11-02T04:12:14.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
118972024-11-02T04:12:14.058ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cea824d5-f6fb-4440-a500-61215006b195", "content-length": "52", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
118982024-11-02T04:12:14.058ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch_location = Switch0
118992024-11-02T04:12:14.058ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119002024-11-02T04:12:14.059ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
119012024-11-02T04:12:14.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
119022024-11-02T04:12:14.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
119032024-11-02T04:12:14.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119042024-11-02T04:12:14.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
119052024-11-02T04:12:14.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
119062024-11-02T04:12:14.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
119072024-11-02T04:12:14.065ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
119082024-11-02T04:12:14.065ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 27d7c9ec-b8a8-4b31-ae12-c49ad36788f1, kind: Service { id: 7f79c18f-7b53-4b8a-86fc-bb23b923ea1d }, name: Name("external-dns-7f79c18f-7b53-4b8a-86fc-bb23b923ea1d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 29b92946-7588-4b89-8147-322049e1f231, kind: Service { id: f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b }, name: Name("external-dns-f3f0a2f4-1758-4c7a-a161-a4eb08bdc03b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 77])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0cd6826d-84a0-4cd5-b7c6-32cb83627e6c, kind: Service { id: 9325209d-81b8-49e4-be6a-cedff3ef78c1 }, name: Name("nexus-9325209d-81b8-49e4-be6a-cedff3ef78c1"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 104])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ec778b7a-3947-4776-98f2-be2ced817d66, kind: Service { id: d2bdfdcf-c904-463a-87e2-60b209fd743f }, name: Name("nexus-d2bdfdcf-c904-463a-87e2-60b209fd743f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f830fe44-0004-4968-88e2-304301a5a810, kind: Service { id: 060b7a36-3ed1-4e47-89cf-3f46bfb09b6c }, name: Name("nexus-060b7a36-3ed1-4e47-89cf-3f46bfb09b6c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
119092024-11-02T04:12:14.065ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
119102024-11-02T04:12:14.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a817d50d-e818-4e60-916a-382dd768eedf", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
119112024-11-02T04:12:14.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119122024-11-02T04:12:14.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119132024-11-02T04:12:14.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a005a4cb-85ec-4150-a749-cf5b925ba9ce", "content-length": "691", "date": "Sat, 02 Nov 2024 04:12:13 GMT"} })
119142024-11-02T04:12:14.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119152024-11-02T04:12:14.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119162024-11-02T04:12:14.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119172024-11-02T04:12:14.109ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.689116ms iteration = 32 status = {}
119182024-11-02T04:12:14.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119192024-11-02T04:12:14.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119202024-11-02T04:12:14.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119212024-11-02T04:12:14.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119222024-11-02T04:12:14.115ZINFOnexus (BackgroundTasks): VPC route manager sled 5b8cdd5a-f021-45f2-8323-b6c8f9776060 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119232024-11-02T04:12:14.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119242024-11-02T04:12:14.116ZDEBGnexus (BackgroundTasks): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15986183-6559-4c92-ade4-24d72754f24e", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
119252024-11-02T04:12:14.118ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 573.030246ms iteration = 33 status = {}
119262024-11-02T04:12:14.118ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, time_created: 2024-11-02T03:57:50.261091Z, time_modified: 2024-11-02T03:57:50.261091Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e190f004-2376-4aae-8296-5a5757dc1123, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
119272024-11-02T04:12:14.118ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
119282024-11-02T04:12:14.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
119292024-11-02T04:12:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
119302024-11-02T04:12:14.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
119312024-11-02T04:12:14.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
119322024-11-02T04:12:14.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119332024-11-02T04:12:14.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5b8cdd5a-f021-45f2-8323-b6c8f9776060, lookup_type: ById(5b8cdd5a-f021-45f2-8323-b6c8f9776060) } result = Ok(())
119342024-11-02T04:12:14.156ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
119352024-11-02T04:12:14.157ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5b8cdd5a-f021-45f2-8323-b6c8f9776060 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4dfc095c-7b6b-4396-b13e-ef69591a5e67", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
119362024-11-02T04:12:14.158ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
119372024-11-02T04:12:14.158ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 613.2834ms
119382024-11-02T04:12:14.158ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 613.29331ms iteration = 4 status = {}
119392024-11-02T04:12:14.233ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "03014db3-564f-4e3d-aab3-480c64735a5e", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
119402024-11-02T04:12:14.233ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e190f004-2376-4aae-8296-5a5757dc1123 switch = Switch0
119412024-11-02T04:12:14.233ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e190f004-2376-4aae-8296-5a5757dc1123 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119422024-11-02T04:12:14.233ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e190f004-2376-4aae-8296-5a5757dc1123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "35b9bb4d-7a6e-4638-bf2d-4f8142a765bd", "content-length": "682", "date": "Sat, 02 Nov 2024 04:12:14 GMT"} })
119432024-11-02T04:12:14.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119442024-11-02T04:12:14.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119452024-11-02T04:12:14.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119462024-11-02T04:12:14.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119472024-11-02T04:12:14.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119482024-11-02T04:12:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119492024-11-02T04:12:14.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119502024-11-02T04:12:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119512024-11-02T04:12:14.251ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.951271ms iteration = 31 status = {}
119522024-11-02T04:12:15.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d77ca1fd-6a1c-4cc3-b3d5-c33ae4d4f3bf roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119532024-11-02T04:12:15.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d77ca1fd-6a1c-4cc3-b3d5-c33ae4d4f3bf resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119542024-11-02T04:12:15.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d77ca1fd-6a1c-4cc3-b3d5-c33ae4d4f3bf response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119552024-11-02T04:12:16.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f7c76543-4aa2-4ca8-ae19-20e9b6a82a4e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119562024-11-02T04:12:16.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f7c76543-4aa2-4ca8-ae19-20e9b6a82a4e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119572024-11-02T04:12:16.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = f7c76543-4aa2-4ca8-ae19-20e9b6a82a4e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119582024-11-02T04:12:17.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5391016d-6ca9-4866-b218-0ef1957e425f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119592024-11-02T04:12:17.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5391016d-6ca9-4866-b218-0ef1957e425f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119602024-11-02T04:12:17.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 5391016d-6ca9-4866-b218-0ef1957e425f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119612024-11-02T04:12:18.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b3883e2-75d1-4596-aae7-082e217fa3c0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119622024-11-02T04:12:18.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b3883e2-75d1-4596-aae7-082e217fa3c0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119632024-11-02T04:12:18.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8b3883e2-75d1-4596-aae7-082e217fa3c0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119642024-11-02T04:12:19.116ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36759
119652024-11-02T04:12:19.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36759 req_id = 7811cd72-c875-4d8a-833b-9adf0ab70284 roles = RoleSet { roles: {} } uri = /metrics/producers
119662024-11-02T04:12:19.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36759 req_id = 7811cd72-c875-4d8a-833b-9adf0ab70284 resource = Database result = Ok(()) uri = /metrics/producers
119672024-11-02T04:12:19.152ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 6b8d67f3-a714-4683-8553-09335a4a9d26
119682024-11-02T04:12:19.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35919 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36759 req_id = 7811cd72-c875-4d8a-833b-9adf0ab70284 response_code = 201 uri = /metrics/producers
119692024-11-02T04:12:19.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 066d6329-2bce-45ae-bba7-22216527c462 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119702024-11-02T04:12:19.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 066d6329-2bce-45ae-bba7-22216527c462 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119712024-11-02T04:12:19.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 066d6329-2bce-45ae-bba7-22216527c462 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119722024-11-02T04:12:20.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a392612-b48d-420b-b6a7-46f71b5cde14 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119732024-11-02T04:12:20.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a392612-b48d-420b-b6a7-46f71b5cde14 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119742024-11-02T04:12:20.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3a392612-b48d-420b-b6a7-46f71b5cde14 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119752024-11-02T04:12:20.780ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50923
119762024-11-02T04:12:20.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50923 req_id = 8b6b906d-7d43-4bc4-9b18-3f72ea2a3cd1 roles = RoleSet { roles: {} } uri = /metrics/producers
119772024-11-02T04:12:20.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50923 req_id = 8b6b906d-7d43-4bc4-9b18-3f72ea2a3cd1 resource = Database result = Ok(()) uri = /metrics/producers
119782024-11-02T04:12:20.813ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = bbe1fec9-a47f-440b-bc9d-2726d77e81dc
119792024-11-02T04:12:20.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32955 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50923 req_id = 8b6b906d-7d43-4bc4-9b18-3f72ea2a3cd1 response_code = 201 uri = /metrics/producers
119802024-11-02T04:12:21.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46499edb-8841-4b59-8226-c8f012dc764b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119812024-11-02T04:12:21.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46499edb-8841-4b59-8226-c8f012dc764b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119822024-11-02T04:12:21.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 46499edb-8841-4b59-8226-c8f012dc764b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119832024-11-02T04:12:22.055ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60124
119842024-11-02T04:12:22.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60124 req_id = 0a563ad4-7c14-46c7-933e-5fecf5e2467e roles = RoleSet { roles: {} } uri = /metrics/producers
119852024-11-02T04:12:22.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60124 req_id = 0a563ad4-7c14-46c7-933e-5fecf5e2467e resource = Database result = Ok(()) uri = /metrics/producers
119862024-11-02T04:12:22.065ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d565c44-21ca-41c0-b1d4-bcace41c9902
119872024-11-02T04:12:22.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9943 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60124 req_id = 0a563ad4-7c14-46c7-933e-5fecf5e2467e response_code = 201 uri = /metrics/producers
119882024-11-02T04:12:22.203ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57951
119892024-11-02T04:12:22.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57951 req_id = 716e7a5b-1a28-4bb5-aca0-60ddd556923e roles = RoleSet { roles: {} } uri = /metrics/producers
119902024-11-02T04:12:22.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57951 req_id = 716e7a5b-1a28-4bb5-aca0-60ddd556923e resource = Database result = Ok(()) uri = /metrics/producers
119912024-11-02T04:12:22.237ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = df01f79b-0682-4f1b-aa97-1a8bb18b9157
119922024-11-02T04:12:22.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33590 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57951 req_id = 716e7a5b-1a28-4bb5-aca0-60ddd556923e response_code = 201 uri = /metrics/producers
119932024-11-02T04:12:22.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ae8bde3-78eb-401d-9c15-c269631d179e roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119942024-11-02T04:12:22.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ae8bde3-78eb-401d-9c15-c269631d179e resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119952024-11-02T04:12:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 0ae8bde3-78eb-401d-9c15-c269631d179e response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
119962024-11-02T04:12:22.399ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33990
119972024-11-02T04:12:22.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33990 req_id = cf59cbd9-50a0-48d9-918e-b9419e2b026a roles = RoleSet { roles: {} } uri = /metrics/producers
119982024-11-02T04:12:22.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33990 req_id = cf59cbd9-50a0-48d9-918e-b9419e2b026a resource = Database result = Ok(()) uri = /metrics/producers
119992024-11-02T04:12:22.407ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 84e94f83-f18a-4122-a272-bfe20f1486da
120002024-11-02T04:12:22.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8416 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33990 req_id = cf59cbd9-50a0-48d9-918e-b9419e2b026a response_code = 201 uri = /metrics/producers
120012024-11-02T04:12:23.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6976bd5b-f8bf-4ee3-b7b9-f6f4d18d365b roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120022024-11-02T04:12:23.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6976bd5b-f8bf-4ee3-b7b9-f6f4d18d365b resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120032024-11-02T04:12:23.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6976bd5b-f8bf-4ee3-b7b9-f6f4d18d365b response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120042024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
120052024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120062024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
120072024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120082024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120092024-11-02T04:12:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120102024-11-02T04:12:23.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120112024-11-02T04:12:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120122024-11-02T04:12:23.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120132024-11-02T04:12:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120142024-11-02T04:12:23.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120152024-11-02T04:12:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120162024-11-02T04:12:23.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120172024-11-02T04:12:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
120182024-11-02T04:12:23.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120192024-11-02T04:12:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120202024-11-02T04:12:23.567ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
120212024-11-02T04:12:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.8646ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
120222024-11-02T04:12:23.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120232024-11-02T04:12:23.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120242024-11-02T04:12:23.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.83276ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120252024-11-02T04:12:23.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1402 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 0a970269-852b-4bdb-a890-2b7841471519 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
120262024-11-02T04:12:24.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a5718e7-9013-43c8-877b-57faf24206c7 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120272024-11-02T04:12:24.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a5718e7-9013-43c8-877b-57faf24206c7 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120282024-11-02T04:12:24.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 9a5718e7-9013-43c8-877b-57faf24206c7 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120292024-11-02T04:12:25.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d2cc8d0a-5b90-44c8-9e96-6f200f352318 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120302024-11-02T04:12:25.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d2cc8d0a-5b90-44c8-9e96-6f200f352318 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120312024-11-02T04:12:25.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d2cc8d0a-5b90-44c8-9e96-6f200f352318 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120322024-11-02T04:12:26.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a9bdc310-3f0a-4c5d-b3bd-fd8ce4a06775 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120332024-11-02T04:12:26.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a9bdc310-3f0a-4c5d-b3bd-fd8ce4a06775 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120342024-11-02T04:12:26.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = a9bdc310-3f0a-4c5d-b3bd-fd8ce4a06775 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120352024-11-02T04:12:27.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef3b5a64-02ef-4077-8b08-d2f9e6343d8f roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120362024-11-02T04:12:27.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef3b5a64-02ef-4077-8b08-d2f9e6343d8f resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120372024-11-02T04:12:27.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ef3b5a64-02ef-4077-8b08-d2f9e6343d8f response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120382024-11-02T04:12:28.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b7ecffc-cc84-491f-aba3-090b15163fdc roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120392024-11-02T04:12:28.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b7ecffc-cc84-491f-aba3-090b15163fdc resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120402024-11-02T04:12:28.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6b7ecffc-cc84-491f-aba3-090b15163fdc response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120412024-11-02T04:12:29.382ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43555
120422024-11-02T04:12:29.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43555 req_id = fd4831fc-a34b-43fb-b8e3-0a6b4fa49fdc roles = RoleSet { roles: {} } uri = /metrics/producers
120432024-11-02T04:12:29.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43555 req_id = fd4831fc-a34b-43fb-b8e3-0a6b4fa49fdc resource = Database result = Ok(()) uri = /metrics/producers
120442024-11-02T04:12:29.391ZINFOnexus: assigned collector to new producer collector_id = 3975424e-54cf-46ad-bdc1-6b8ad0a2e4f0 file = nexus/src/app/oximeter.rs:76 producer_id = 5b8cdd5a-f021-45f2-8323-b6c8f9776060
120452024-11-02T04:12:29.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9568 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43555 req_id = fd4831fc-a34b-43fb-b8e3-0a6b4fa49fdc response_code = 201 uri = /metrics/producers
120462024-11-02T04:12:29.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb1a6a7b-0519-4951-9516-dc209147bdc3 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120472024-11-02T04:12:29.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb1a6a7b-0519-4951-9516-dc209147bdc3 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120482024-11-02T04:12:29.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = eb1a6a7b-0519-4951-9516-dc209147bdc3 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120492024-11-02T04:12:30.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7667ae5-8ca5-4e7d-8b65-d45129c877d0 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120502024-11-02T04:12:30.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7667ae5-8ca5-4e7d-8b65-d45129c877d0 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120512024-11-02T04:12:30.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = d7667ae5-8ca5-4e7d-8b65-d45129c877d0 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120522024-11-02T04:12:31.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8ce4693-7394-432e-93e2-378bef207081 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120532024-11-02T04:12:31.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8ce4693-7394-432e-93e2-378bef207081 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120542024-11-02T04:12:31.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = c8ce4693-7394-432e-93e2-378bef207081 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120552024-11-02T04:12:32.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87b1d000-8871-4ef7-884b-d43bf47a5d2a roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120562024-11-02T04:12:32.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87b1d000-8871-4ef7-884b-d43bf47a5d2a resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120572024-11-02T04:12:32.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 87b1d000-8871-4ef7-884b-d43bf47a5d2a response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120582024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
120592024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120602024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
120612024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120622024-11-02T04:12:33.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e8f1f58d-5391-4a4b-9abd-aea03d28a65d roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120632024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120642024-11-02T04:12:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120652024-11-02T04:12:33.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e8f1f58d-5391-4a4b-9abd-aea03d28a65d resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120662024-11-02T04:12:33.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120672024-11-02T04:12:33.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = e8f1f58d-5391-4a4b-9abd-aea03d28a65d response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120682024-11-02T04:12:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120692024-11-02T04:12:33.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120702024-11-02T04:12:33.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120712024-11-02T04:12:33.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120722024-11-02T04:12:33.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120732024-11-02T04:12:33.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120742024-11-02T04:12:33.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cac56846-ee51-402c-96d1-00442596b57c, lookup_type: ById(cac56846-ee51-402c-96d1-00442596b57c) } result = Ok(())
120752024-11-02T04:12:33.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120762024-11-02T04:12:33.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120772024-11-02T04:12:33.568ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cac56846-ee51-402c-96d1-00442596b57c original_time_created = 2024-11-02 03:57:01.367966 UTC target_id = cac56846-ee51-402c-96d1-00442596b57c time_created = 2024-11-02 03:57:01.367966 UTC
120782024-11-02T04:12:33.568ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.258049ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cac56846-ee51-402c-96d1-00442596b57c","time_created":"2024-11-02T03:57:01.367966Z"}
120792024-11-02T04:12:33.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120802024-11-02T04:12:33.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120812024-11-02T04:12:33.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.472566ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120822024-11-02T04:12:34.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f9ca097-a15b-461a-8dcd-fb5bb6acdfda roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120832024-11-02T04:12:34.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f9ca097-a15b-461a-8dcd-fb5bb6acdfda resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120842024-11-02T04:12:34.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 1f9ca097-a15b-461a-8dcd-fb5bb6acdfda response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120852024-11-02T04:12:35.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6bfa1724-663c-4032-8634-9260d63e4cad roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120862024-11-02T04:12:35.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6bfa1724-663c-4032-8634-9260d63e4cad resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120872024-11-02T04:12:35.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 6bfa1724-663c-4032-8634-9260d63e4cad response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120882024-11-02T04:12:36.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = baabcc79-bf86-44bd-9827-dd1f1ab1bd29 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120892024-11-02T04:12:36.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = baabcc79-bf86-44bd-9827-dd1f1ab1bd29 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120902024-11-02T04:12:36.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = baabcc79-bf86-44bd-9827-dd1f1ab1bd29 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120912024-11-02T04:12:36.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d334858-c398-45f5-b991-418fd28a839d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
120922024-11-02T04:12:36.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d334858-c398-45f5-b991-418fd28a839d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
120932024-11-02T04:12:36.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35773 req_id = 1d334858-c398-45f5-b991-418fd28a839d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
120942024-11-02T04:12:37.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee693013-da60-472f-965a-4b5443046a11 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120952024-11-02T04:12:37.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee693013-da60-472f-965a-4b5443046a11 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120962024-11-02T04:12:37.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = ee693013-da60-472f-965a-4b5443046a11 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120972024-11-02T04:12:38.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3ce1618f-1268-41ba-b5a9-7ea9364bdf11 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120982024-11-02T04:12:38.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3ce1618f-1268-41ba-b5a9-7ea9364bdf11 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
120992024-11-02T04:12:38.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 3ce1618f-1268-41ba-b5a9-7ea9364bdf11 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121002024-11-02T04:12:38.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:43263 method = GET remote_addr = [fd00:1122:3344:101::d]:52885 req_id = 1adbd294-ed29-4c9c-aec6-7219d89ba1d6 response_code = 200 uri = /060b7a36-3ed1-4e47-89cf-3f46bfb09b6c
121012024-11-02T04:12:39.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a5a1a3e-0e84-4864-89d2-dbdceac7a495 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121022024-11-02T04:12:39.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a5a1a3e-0e84-4864-89d2-dbdceac7a495 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121032024-11-02T04:12:39.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = 8a5a1a3e-0e84-4864-89d2-dbdceac7a495 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121042024-11-02T04:12:40.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c8c16c-3f31-4df5-aecf-71e15139cf37 roles = RoleSet { roles: {} } uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121052024-11-02T04:12:40.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c8c16c-3f31-4df5-aecf-71e15139cf37 resource = Database result = Ok(()) uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060
121062024-11-02T04:12:40.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41597 req_id = b6c8c16c-3f31-4df5-aecf-71e15139cf37 response_code = 200 uri = /probes/5b8cdd5a-f021-45f2-8323-b6c8f9776060