Max level shown:
12024-12-21T03:00:01.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ca09781-ae6b-42c3-844c-8bf4d5e8322a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
22024-12-21T03:00:01.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ca09781-ae6b-42c3-844c-8bf4d5e8322a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32024-12-21T03:00:01.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ca09781-ae6b-42c3-844c-8bf4d5e8322a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
52024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
72024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92024-12-21T03:00:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102024-12-21T03:00:01.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112024-12-21T03:00:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122024-12-21T03:00:01.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132024-12-21T03:00:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142024-12-21T03:00:01.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152024-12-21T03:00:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162024-12-21T03:00:01.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
172024-12-21T03:00:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
182024-12-21T03:00:01.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192024-12-21T03:00:01.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202024-12-21T03:00:01.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
212024-12-21T03:00:01.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.422649ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
222024-12-21T03:00:01.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
232024-12-21T03:00:01.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
242024-12-21T03:00:01.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.021442ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
252024-12-21T03:00:02.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9a8f9eb-4a8c-479e-9bae-3ee521bf8349 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
262024-12-21T03:00:02.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9a8f9eb-4a8c-479e-9bae-3ee521bf8349 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
272024-12-21T03:00:02.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9a8f9eb-4a8c-479e-9bae-3ee521bf8349 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
282024-12-21T03:00:03.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 39dff54c-29b9-4afd-b89f-c5522661c3ae roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
292024-12-21T03:00:03.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 39dff54c-29b9-4afd-b89f-c5522661c3ae resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
302024-12-21T03:00:03.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 39dff54c-29b9-4afd-b89f-c5522661c3ae response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
312024-12-21T03:00:04.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1463 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 91821e5d-6649-4b0a-a017-dfd598d6dec3 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
322024-12-21T03:00:04.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f9226c4-b7e0-4e04-bbe9-ce70b611f2f8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
332024-12-21T03:00:04.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f9226c4-b7e0-4e04-bbe9-ce70b611f2f8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
342024-12-21T03:00:04.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f9226c4-b7e0-4e04-bbe9-ce70b611f2f8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
352024-12-21T03:00:05.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68876a64-2da0-4660-95a0-cd862f1fca49 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
362024-12-21T03:00:05.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68876a64-2da0-4660-95a0-cd862f1fca49 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
372024-12-21T03:00:05.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68876a64-2da0-4660-95a0-cd862f1fca49 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
382024-12-21T03:00:06.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1492f93-07a0-4879-b0a4-f168fdb0081d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
392024-12-21T03:00:06.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1492f93-07a0-4879-b0a4-f168fdb0081d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
402024-12-21T03:00:06.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1492f93-07a0-4879-b0a4-f168fdb0081d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
412024-12-21T03:00:07.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ced9dad-14e4-417f-b938-aa3602f20e00 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
422024-12-21T03:00:07.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ced9dad-14e4-417f-b938-aa3602f20e00 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
432024-12-21T03:00:07.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ced9dad-14e4-417f-b938-aa3602f20e00 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
442024-12-21T03:00:08.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53ed1f71-62d9-46d8-b9b2-57ecf28fd760 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
452024-12-21T03:00:08.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53ed1f71-62d9-46d8-b9b2-57ecf28fd760 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
462024-12-21T03:00:08.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53ed1f71-62d9-46d8-b9b2-57ecf28fd760 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
472024-12-21T03:00:09.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d10ded-8b35-4d72-9a9c-b13c6fc4b5ad roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
482024-12-21T03:00:09.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d10ded-8b35-4d72-9a9c-b13c6fc4b5ad resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
492024-12-21T03:00:09.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d10ded-8b35-4d72-9a9c-b13c6fc4b5ad response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
502024-12-21T03:00:10.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7fc2aa-ed94-4be2-9d80-44f4dbf60236 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
512024-12-21T03:00:10.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7fc2aa-ed94-4be2-9d80-44f4dbf60236 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
522024-12-21T03:00:10.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7fc2aa-ed94-4be2-9d80-44f4dbf60236 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
532024-12-21T03:00:11.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9fc0ba76-bdf7-4f8c-9e3a-0bcfb9855ecd roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
542024-12-21T03:00:11.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9fc0ba76-bdf7-4f8c-9e3a-0bcfb9855ecd resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
552024-12-21T03:00:11.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9fc0ba76-bdf7-4f8c-9e3a-0bcfb9855ecd response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
562024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
572024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
582024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
592024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
602024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
612024-12-21T03:00:11.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
622024-12-21T03:00:11.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
632024-12-21T03:00:11.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
642024-12-21T03:00:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
652024-12-21T03:00:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
662024-12-21T03:00:11.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
672024-12-21T03:00:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
682024-12-21T03:00:11.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
692024-12-21T03:00:11.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
702024-12-21T03:00:11.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
712024-12-21T03:00:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
722024-12-21T03:00:11.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
732024-12-21T03:00:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
742024-12-21T03:00:11.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
752024-12-21T03:00:11.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.84292ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
762024-12-21T03:00:11.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.408943ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
772024-12-21T03:00:12.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e6b9e89-4547-4845-a149-bda7be68347a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
782024-12-21T03:00:12.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e6b9e89-4547-4845-a149-bda7be68347a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
792024-12-21T03:00:12.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e6b9e89-4547-4845-a149-bda7be68347a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
802024-12-21T03:00:13.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 117c24c5-5c08-4173-abfe-ba5256c46c0e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
812024-12-21T03:00:13.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 117c24c5-5c08-4173-abfe-ba5256c46c0e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
822024-12-21T03:00:13.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 117c24c5-5c08-4173-abfe-ba5256c46c0e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
832024-12-21T03:00:14.036ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1441 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = cedbe3ad-e22f-497b-b847-14d546cf7dd2 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
842024-12-21T03:00:14.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97e0e7d6-ba20-404e-a8d4-4c7c6026da25 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
852024-12-21T03:00:14.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97e0e7d6-ba20-404e-a8d4-4c7c6026da25 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
862024-12-21T03:00:14.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97e0e7d6-ba20-404e-a8d4-4c7c6026da25 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
872024-12-21T03:00:15.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de0b40f5-9612-4e27-8d1d-b4d07cdc48ba roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
882024-12-21T03:00:15.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de0b40f5-9612-4e27-8d1d-b4d07cdc48ba resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
892024-12-21T03:00:15.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de0b40f5-9612-4e27-8d1d-b4d07cdc48ba response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
902024-12-21T03:00:16.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17b91964-40d0-4112-ad55-ec438c443b45 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
912024-12-21T03:00:16.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17b91964-40d0-4112-ad55-ec438c443b45 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
922024-12-21T03:00:16.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17b91964-40d0-4112-ad55-ec438c443b45 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
932024-12-21T03:00:17.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 21434dd2-61a7-470f-a8bc-43954df0924e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
942024-12-21T03:00:17.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 21434dd2-61a7-470f-a8bc-43954df0924e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
952024-12-21T03:00:17.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 21434dd2-61a7-470f-a8bc-43954df0924e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
962024-12-21T03:00:18.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33866cdd-adcc-4f77-9baa-a6eae6972300 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
972024-12-21T03:00:18.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33866cdd-adcc-4f77-9baa-a6eae6972300 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
982024-12-21T03:00:18.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33866cdd-adcc-4f77-9baa-a6eae6972300 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
992024-12-21T03:00:19.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ab2347-8a0b-4c01-8aec-f2099c30a7ce roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1002024-12-21T03:00:19.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ab2347-8a0b-4c01-8aec-f2099c30a7ce resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1012024-12-21T03:00:19.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ab2347-8a0b-4c01-8aec-f2099c30a7ce response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1022024-12-21T03:00:20.163ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:54687
1032024-12-21T03:00:20.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54687 req_id = 13ef7b72-108a-4376-9a74-f374c3decd07 roles = RoleSet { roles: {} } uri = /metrics/producers
1042024-12-21T03:00:20.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54687 req_id = 13ef7b72-108a-4376-9a74-f374c3decd07 resource = Database result = Ok(()) uri = /metrics/producers
1052024-12-21T03:00:20.204ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1062024-12-21T03:00:20.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41325 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54687 req_id = 13ef7b72-108a-4376-9a74-f374c3decd07 response_code = 201 uri = /metrics/producers
1072024-12-21T03:00:20.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb5a8454-a120-43e9-a83c-1ebdcd2c863f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1082024-12-21T03:00:20.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb5a8454-a120-43e9-a83c-1ebdcd2c863f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1092024-12-21T03:00:20.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb5a8454-a120-43e9-a83c-1ebdcd2c863f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1102024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
1112024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1122024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
1132024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1142024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1152024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
1162024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
1172024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
1182024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1192024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1202024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1212024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
1222024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1232024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
1242024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1252024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
1262024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1272024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
1282024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1292024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1302024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
1312024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1322024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1332024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
1342024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1352024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
1362024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1372024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
1382024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
1392024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1402024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
1412024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1422024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
1432024-12-21T03:00:21.837ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1442024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
1452024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1462024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1472024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1482024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1492024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1502024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1512024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1522024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1532024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1542024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1552024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1562024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1572024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1582024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1592024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1602024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1612024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1622024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1632024-12-21T03:00:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1642024-12-21T03:00:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1652024-12-21T03:00:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1662024-12-21T03:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672024-12-21T03:00:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.008947ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1682024-12-21T03:00:21.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1667, tv_nsec: 899721306 } })
1692024-12-21T03:00:21.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
1702024-12-21T03:00:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.695855ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
1712024-12-21T03:00:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1722024-12-21T03:00:21.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1732024-12-21T03:00:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1742024-12-21T03:00:21.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752024-12-21T03:00:21.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-12-21T03:00:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1772024-12-21T03:00:21.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1782024-12-21T03:00:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1792024-12-21T03:00:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1802024-12-21T03:00:21.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1812024-12-21T03:00:21.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1822024-12-21T03:00:21.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = be2e2b2f-154f-4eb6-91bc-ad00699287ff roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1832024-12-21T03:00:21.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = be2e2b2f-154f-4eb6-91bc-ad00699287ff resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1842024-12-21T03:00:21.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1667, tv_nsec: 913547578 } })
1852024-12-21T03:00:21.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
1862024-12-21T03:00:21.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1872024-12-21T03:00:21.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1882024-12-21T03:00:21.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1667, tv_nsec: 915420430 } })
1892024-12-21T03:00:21.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
1902024-12-21T03:00:21.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = be2e2b2f-154f-4eb6-91bc-ad00699287ff response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1912024-12-21T03:00:21.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1922024-12-21T03:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1932024-12-21T03:00:21.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-12-21T03:00:21.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1952024-12-21T03:00:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1962024-12-21T03:00:21.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.711467ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
1972024-12-21T03:00:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1982024-12-21T03:00:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1992024-12-21T03:00:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2002024-12-21T03:00:21.892ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2012024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2022024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2032024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2042024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2052024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2062024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2072024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2082024-12-21T03:00:21.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2092024-12-21T03:00:21.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2102024-12-21T03:00:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.766655ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2112024-12-21T03:00:21.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122024-12-21T03:00:21.898ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132024-12-21T03:00:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
2142024-12-21T03:00:21.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2152024-12-21T03:00:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2162024-12-21T03:00:21.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-12-21T03:00:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2182024-12-21T03:00:21.901ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2192024-12-21T03:00:21.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2202024-12-21T03:00:21.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2212024-12-21T03:00:21.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2222024-12-21T03:00:21.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2232024-12-21T03:00:21.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2242024-12-21T03:00:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2252024-12-21T03:00:21.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2262024-12-21T03:00:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2272024-12-21T03:00:21.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2282024-12-21T03:00:21.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2292024-12-21T03:00:21.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-12-21T03:00:21.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.580501ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2312024-12-21T03:00:21.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2322024-12-21T03:00:21.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2332024-12-21T03:00:21.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2342024-12-21T03:00:21.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
2352024-12-21T03:00:21.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.717879ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
2362024-12-21T03:00:21.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372024-12-21T03:00:21.923ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2382024-12-21T03:00:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.39574ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2392024-12-21T03:00:21.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2402024-12-21T03:00:21.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2412024-12-21T03:00:21.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2422024-12-21T03:00:21.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2432024-12-21T03:00:21.928ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2442024-12-21T03:00:21.929ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28f452f4-6437-4b7a-b5bd-df27ab09a587", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
2452024-12-21T03:00:21.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2462024-12-21T03:00:21.931ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2472024-12-21T03:00:21.940ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482024-12-21T03:00:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
2492024-12-21T03:00:21.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2502024-12-21T03:00:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2512024-12-21T03:00:21.947ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2522024-12-21T03:00:21.947ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2532024-12-21T03:00:21.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2542024-12-21T03:00:21.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2552024-12-21T03:00:21.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.641943ms iteration = 22 status = 0
2562024-12-21T03:00:21.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572024-12-21T03:00:21.964ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2582024-12-21T03:00:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2592024-12-21T03:00:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2602024-12-21T03:00:21.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2612024-12-21T03:00:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2622024-12-21T03:00:21.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.558612ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2632024-12-21T03:00:21.972ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2642024-12-21T03:00:21.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2652024-12-21T03:00:21.998ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2662024-12-21T03:00:21.998ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2672024-12-21T03:00:21.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 161.7453ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2682024-12-21T03:00:22.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
2692024-12-21T03:00:22.010ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2702024-12-21T03:00:22.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2712024-12-21T03:00:22.010ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2722024-12-21T03:00:22.010ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1132600a-96a9-4e20-a795-2b2b7583775d", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
2732024-12-21T03:00:22.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2742024-12-21T03:00:22.010ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10095224-d649-4599-9c85-4024e31f33d4", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
2752024-12-21T03:00:22.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2762024-12-21T03:00:22.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2772024-12-21T03:00:22.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2782024-12-21T03:00:22.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2792024-12-21T03:00:22.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
2802024-12-21T03:00:22.054ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.846453ms iteration = 22 status = {}
2812024-12-21T03:00:22.076ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2822024-12-21T03:00:22.076ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2832024-12-21T03:00:22.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1387de-3f0b-451b-91fe-f0c675bef417", "content-length": "372", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
2842024-12-21T03:00:22.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2852024-12-21T03:00:22.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2862024-12-21T03:00:22.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2872024-12-21T03:00:22.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2882024-12-21T03:00:22.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2892024-12-21T03:00:22.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2902024-12-21T03:00:22.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912024-12-21T03:00:22.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2922024-12-21T03:00:22.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2932024-12-21T03:00:22.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2942024-12-21T03:00:22.094ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2952024-12-21T03:00:22.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2962024-12-21T03:00:22.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c6b4dfd-c523-44e9-a059-4df437c8763e", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
2972024-12-21T03:00:22.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2982024-12-21T03:00:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2992024-12-21T03:00:22.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3002024-12-21T03:00:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3012024-12-21T03:00:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3022024-12-21T03:00:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3032024-12-21T03:00:22.107ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3042024-12-21T03:00:22.107ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e435996-594b-455f-b827-087fb993a37a", "content-length": "1", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
3052024-12-21T03:00:22.108ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3062024-12-21T03:00:22.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3072024-12-21T03:00:22.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e17a6c72-90be-49a2-afb8-49b8264b8859", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
3082024-12-21T03:00:22.108ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3092024-12-21T03:00:22.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3102024-12-21T03:00:22.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 272.17735ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3112024-12-21T03:00:22.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 272.827888ms iteration = 23 status = {}
3122024-12-21T03:00:22.111ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 273.92554ms iteration = 22 status = null
3132024-12-21T03:00:22.113ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
3142024-12-21T03:00:22.113ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 276.045355ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3152024-12-21T03:00:22.114ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 276.945006ms iteration = 26 status = {"physical_disks_added":0}
3162024-12-21T03:00:22.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3172024-12-21T03:00:22.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3182024-12-21T03:00:22.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3192024-12-21T03:00:22.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3202024-12-21T03:00:22.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3212024-12-21T03:00:22.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3222024-12-21T03:00:22.168ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
3232024-12-21T03:00:22.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3242024-12-21T03:00:22.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3252024-12-21T03:00:22.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3262024-12-21T03:00:22.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c212c7a-25fc-4a38-86b7-4c3d7927db9f", "content-length": "134", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
3272024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3282024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
3292024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3302024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3312024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3322024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3332024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3342024-12-21T03:00:22.177ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3352024-12-21T03:00:22.178ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3362024-12-21T03:00:22.178ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3372024-12-21T03:00:22.178ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
3382024-12-21T03:00:22.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3392024-12-21T03:00:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3402024-12-21T03:00:22.207ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3412024-12-21T03:00:22.209ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3422024-12-21T03:00:22.209ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a30ff63-b398-4cfa-9c0a-0619c9167d0e", "content-length": "2", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
3432024-12-21T03:00:22.209ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3442024-12-21T03:00:22.209ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a68330e-c8a9-4fa2-8563-c9007168d881", "content-length": "52", "date": "Sat, 21 Dec 2024 03:00:21 GMT"} })
3452024-12-21T03:00:22.209ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
3462024-12-21T03:00:22.209ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3472024-12-21T03:00:22.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "012d4e8d-d892-4eb9-a6ca-297bbf5a330e", "content-length": "691", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
3482024-12-21T03:00:22.292ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3492024-12-21T03:00:22.292ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3502024-12-21T03:00:22.292ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3512024-12-21T03:00:22.295ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.671697ms iteration = 22 status = {}
3522024-12-21T03:00:22.373ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ec0bd503-2301-4334-aa2a-f62a064c5e3e", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
3532024-12-21T03:00:22.373ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
3542024-12-21T03:00:22.373ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3552024-12-21T03:00:22.373ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0b101a1-e9c7-44da-bf22-f064d0f5b282", "content-length": "682", "date": "Sat, 21 Dec 2024 03:00:22 GMT"} })
3562024-12-21T03:00:22.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3572024-12-21T03:00:22.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3582024-12-21T03:00:22.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3592024-12-21T03:00:22.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3602024-12-21T03:00:22.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3612024-12-21T03:00:22.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3622024-12-21T03:00:22.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3632024-12-21T03:00:22.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3642024-12-21T03:00:22.390ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 553.676478ms iteration = 22 status = {}
3652024-12-21T03:00:22.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ce8acce-f4fd-4d5e-a595-6437a80fa9ac roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3662024-12-21T03:00:22.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ce8acce-f4fd-4d5e-a595-6437a80fa9ac resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3672024-12-21T03:00:22.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7ce8acce-f4fd-4d5e-a595-6437a80fa9ac response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3682024-12-21T03:00:22.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = be3f29d6-d07a-44cf-b151-b7a6af8a2c57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3692024-12-21T03:00:22.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = be3f29d6-d07a-44cf-b151-b7a6af8a2c57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3702024-12-21T03:00:22.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = be3f29d6-d07a-44cf-b151-b7a6af8a2c57 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3712024-12-21T03:00:23.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6f5c2d92-4e97-4aba-b822-968a0a5124f7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3722024-12-21T03:00:23.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6f5c2d92-4e97-4aba-b822-968a0a5124f7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3732024-12-21T03:00:23.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6f5c2d92-4e97-4aba-b822-968a0a5124f7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3742024-12-21T03:00:24.036ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1267 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = da7830c4-d2db-49ab-a19c-e9ef55c4c663 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
3752024-12-21T03:00:24.197ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49886
3762024-12-21T03:00:24.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49886 req_id = 96eab675-148f-4bdf-9ca3-b78b221577d2 roles = RoleSet { roles: {} } uri = /metrics/producers
3772024-12-21T03:00:24.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49886 req_id = 96eab675-148f-4bdf-9ca3-b78b221577d2 resource = Database result = Ok(()) uri = /metrics/producers
3782024-12-21T03:00:24.207ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 15f87f8f-adb4-4daa-a123-a8c44178aea2
3792024-12-21T03:00:24.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9747 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49886 req_id = 96eab675-148f-4bdf-9ca3-b78b221577d2 response_code = 201 uri = /metrics/producers
3802024-12-21T03:00:24.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = df851c43-ec0c-441f-bcfa-02b7d6818a7e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3812024-12-21T03:00:24.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = df851c43-ec0c-441f-bcfa-02b7d6818a7e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3822024-12-21T03:00:24.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = df851c43-ec0c-441f-bcfa-02b7d6818a7e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3832024-12-21T03:00:25.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 334910be-b2f1-4bd3-a68f-ef08f40c2997 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3842024-12-21T03:00:25.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 334910be-b2f1-4bd3-a68f-ef08f40c2997 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3852024-12-21T03:00:25.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 334910be-b2f1-4bd3-a68f-ef08f40c2997 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3862024-12-21T03:00:26.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8a8a5050-70cc-4c3c-98c2-6009bc04d2e5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3872024-12-21T03:00:26.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8a8a5050-70cc-4c3c-98c2-6009bc04d2e5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3882024-12-21T03:00:26.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8a8a5050-70cc-4c3c-98c2-6009bc04d2e5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3892024-12-21T03:00:27.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee01ebba-cb73-4658-b3f6-1918cc8a7b9f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3902024-12-21T03:00:27.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee01ebba-cb73-4658-b3f6-1918cc8a7b9f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3912024-12-21T03:00:27.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee01ebba-cb73-4658-b3f6-1918cc8a7b9f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3922024-12-21T03:00:28.434ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42163
3932024-12-21T03:00:28.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42163 req_id = b6807b48-8914-4ecd-aa26-d10ff3fd99d0 roles = RoleSet { roles: {} } uri = /metrics/producers
3942024-12-21T03:00:28.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42163 req_id = b6807b48-8914-4ecd-aa26-d10ff3fd99d0 resource = Database result = Ok(()) uri = /metrics/producers
3952024-12-21T03:00:28.443ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = e07f98b9-1bde-49d3-9706-a165e3c36c5a
3962024-12-21T03:00:28.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8602 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42163 req_id = b6807b48-8914-4ecd-aa26-d10ff3fd99d0 response_code = 201 uri = /metrics/producers
3972024-12-21T03:00:28.606ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49492
3982024-12-21T03:00:28.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49492 req_id = b786d754-840e-41b1-84bb-4059ebaf0846 roles = RoleSet { roles: {} } uri = /metrics/producers
3992024-12-21T03:00:28.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49492 req_id = b786d754-840e-41b1-84bb-4059ebaf0846 resource = Database result = Ok(()) uri = /metrics/producers
4002024-12-21T03:00:28.646ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = e9078b79-b4a7-485d-9b9d-029484c590d3
4012024-12-21T03:00:28.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40237 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49492 req_id = b786d754-840e-41b1-84bb-4059ebaf0846 response_code = 201 uri = /metrics/producers
4022024-12-21T03:00:29.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7a956526-16ab-413f-b71c-fcae6387a60f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4032024-12-21T03:00:29.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7a956526-16ab-413f-b71c-fcae6387a60f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4042024-12-21T03:00:29.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7a956526-16ab-413f-b71c-fcae6387a60f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4052024-12-21T03:00:30.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 94cb675b-8bd3-4bba-a382-88a3e5274300 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4062024-12-21T03:00:30.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 94cb675b-8bd3-4bba-a382-88a3e5274300 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4072024-12-21T03:00:30.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 94cb675b-8bd3-4bba-a382-88a3e5274300 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4082024-12-21T03:00:31.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0c18f43-4535-40f3-8a47-7eca1d78790d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4092024-12-21T03:00:31.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0c18f43-4535-40f3-8a47-7eca1d78790d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4102024-12-21T03:00:31.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0c18f43-4535-40f3-8a47-7eca1d78790d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4112024-12-21T03:00:31.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
4122024-12-21T03:00:31.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4132024-12-21T03:00:31.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
4142024-12-21T03:00:31.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-12-21T03:00:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4162024-12-21T03:00:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4172024-12-21T03:00:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4182024-12-21T03:00:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4192024-12-21T03:00:31.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4202024-12-21T03:00:31.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.268169ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4212024-12-21T03:00:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4222024-12-21T03:00:31.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4232024-12-21T03:00:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4242024-12-21T03:00:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4252024-12-21T03:00:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4262024-12-21T03:00:31.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4272024-12-21T03:00:31.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
4282024-12-21T03:00:31.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4292024-12-21T03:00:31.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4302024-12-21T03:00:31.885ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
4312024-12-21T03:00:31.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.321474ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
4322024-12-21T03:00:32.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5cc6a0a-7b9c-4dad-b0a7-22ebfecaf787 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4332024-12-21T03:00:32.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5cc6a0a-7b9c-4dad-b0a7-22ebfecaf787 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4342024-12-21T03:00:32.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5cc6a0a-7b9c-4dad-b0a7-22ebfecaf787 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4352024-12-21T03:00:33.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d45c9c56-ba1e-4070-a7c3-ac7d44a98f82 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4362024-12-21T03:00:33.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d45c9c56-ba1e-4070-a7c3-ac7d44a98f82 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4372024-12-21T03:00:33.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d45c9c56-ba1e-4070-a7c3-ac7d44a98f82 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4382024-12-21T03:00:34.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1237 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 4d7c9746-cf60-4b98-afac-819331e72177 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
4392024-12-21T03:00:34.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ad161c85-8111-4665-b09e-5040e7417a72 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4402024-12-21T03:00:34.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ad161c85-8111-4665-b09e-5040e7417a72 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4412024-12-21T03:00:34.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ad161c85-8111-4665-b09e-5040e7417a72 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4422024-12-21T03:00:35.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3137df30-53e3-4d10-a726-07db1b06bd9d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4432024-12-21T03:00:35.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3137df30-53e3-4d10-a726-07db1b06bd9d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4442024-12-21T03:00:35.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3137df30-53e3-4d10-a726-07db1b06bd9d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4452024-12-21T03:00:36.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ef70593c-7ad4-400d-b54c-ef1ea11d1f7b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4462024-12-21T03:00:36.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ef70593c-7ad4-400d-b54c-ef1ea11d1f7b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4472024-12-21T03:00:36.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ef70593c-7ad4-400d-b54c-ef1ea11d1f7b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4482024-12-21T03:00:37.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a0d870f8-bfcc-423e-8501-241801799975 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4492024-12-21T03:00:37.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a0d870f8-bfcc-423e-8501-241801799975 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4502024-12-21T03:00:37.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a0d870f8-bfcc-423e-8501-241801799975 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4512024-12-21T03:00:38.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 317ad8f5-f1b8-419c-b4c9-a541176fa662 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4522024-12-21T03:00:38.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 317ad8f5-f1b8-419c-b4c9-a541176fa662 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4532024-12-21T03:00:38.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 317ad8f5-f1b8-419c-b4c9-a541176fa662 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4542024-12-21T03:00:39.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e29b1ab8-ad90-44dd-a246-293b77d30660 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4552024-12-21T03:00:39.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e29b1ab8-ad90-44dd-a246-293b77d30660 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4562024-12-21T03:00:39.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e29b1ab8-ad90-44dd-a246-293b77d30660 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4572024-12-21T03:00:40.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c5fe8178-1d83-46a2-929b-b6c8d5e76914 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4582024-12-21T03:00:40.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c5fe8178-1d83-46a2-929b-b6c8d5e76914 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4592024-12-21T03:00:40.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c5fe8178-1d83-46a2-929b-b6c8d5e76914 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4602024-12-21T03:00:41.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a127c8a-f8dc-4e6d-bac0-10606a025934 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4612024-12-21T03:00:41.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a127c8a-f8dc-4e6d-bac0-10606a025934 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4622024-12-21T03:00:41.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a127c8a-f8dc-4e6d-bac0-10606a025934 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4632024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
4642024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4652024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
4662024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4682024-12-21T03:00:41.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4692024-12-21T03:00:41.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4702024-12-21T03:00:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4712024-12-21T03:00:41.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4722024-12-21T03:00:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4732024-12-21T03:00:41.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4742024-12-21T03:00:41.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4752024-12-21T03:00:41.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4762024-12-21T03:00:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
4772024-12-21T03:00:41.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4782024-12-21T03:00:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4792024-12-21T03:00:41.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
4802024-12-21T03:00:41.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.543728ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
4812024-12-21T03:00:41.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4822024-12-21T03:00:41.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4832024-12-21T03:00:41.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.91321ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4842024-12-21T03:00:42.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 598661f1-0093-4b99-be33-eaf2415f0011 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4852024-12-21T03:00:42.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 598661f1-0093-4b99-be33-eaf2415f0011 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4862024-12-21T03:00:42.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 598661f1-0093-4b99-be33-eaf2415f0011 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4872024-12-21T03:00:43.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cfcb428-24f9-4720-a6b5-f8b292592ecb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4882024-12-21T03:00:43.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cfcb428-24f9-4720-a6b5-f8b292592ecb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4892024-12-21T03:00:43.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cfcb428-24f9-4720-a6b5-f8b292592ecb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4902024-12-21T03:00:44.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1332 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 27b146c0-738c-4787-b112-4f592946c1ae response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
4912024-12-21T03:00:44.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 603868bc-9f52-47dd-8afb-ba16c3638cbe roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4922024-12-21T03:00:44.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 603868bc-9f52-47dd-8afb-ba16c3638cbe resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4932024-12-21T03:00:44.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 603868bc-9f52-47dd-8afb-ba16c3638cbe response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4942024-12-21T03:00:45.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6defe09d-f983-4044-8a79-49ec54f18bdd roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4952024-12-21T03:00:45.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6defe09d-f983-4044-8a79-49ec54f18bdd resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4962024-12-21T03:00:45.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6defe09d-f983-4044-8a79-49ec54f18bdd response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4972024-12-21T03:00:46.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b2cd3c5f-d915-4c99-b774-8702c5bfe679 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4982024-12-21T03:00:46.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b2cd3c5f-d915-4c99-b774-8702c5bfe679 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4992024-12-21T03:00:46.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b2cd3c5f-d915-4c99-b774-8702c5bfe679 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5002024-12-21T03:00:47.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb908755-e137-4b17-835c-5a01a4ff6b02 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5012024-12-21T03:00:47.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb908755-e137-4b17-835c-5a01a4ff6b02 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5022024-12-21T03:00:47.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb908755-e137-4b17-835c-5a01a4ff6b02 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5032024-12-21T03:00:48.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c3ea54a-5215-4cb3-824e-a84e6c7349b6 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5042024-12-21T03:00:48.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c3ea54a-5215-4cb3-824e-a84e6c7349b6 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5052024-12-21T03:00:48.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c3ea54a-5215-4cb3-824e-a84e6c7349b6 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5062024-12-21T03:00:48.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41147
5072024-12-21T03:00:48.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41147 req_id = 1a51fa20-472d-47dd-ba70-6004ada31f78 roles = RoleSet { roles: {} } uri = /metrics/producers
5082024-12-21T03:00:48.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41147 req_id = 1a51fa20-472d-47dd-ba70-6004ada31f78 resource = Database result = Ok(()) uri = /metrics/producers
5092024-12-21T03:00:48.957ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 4a72b7dd-4681-40e1-99ca-ee46110d2a13
5102024-12-21T03:00:48.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36694 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41147 req_id = 1a51fa20-472d-47dd-ba70-6004ada31f78 response_code = 201 uri = /metrics/producers
5112024-12-21T03:00:49.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 791a3935-3c0f-48bc-8485-5d6b7fed8d79 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5122024-12-21T03:00:49.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 791a3935-3c0f-48bc-8485-5d6b7fed8d79 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5132024-12-21T03:00:49.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 791a3935-3c0f-48bc-8485-5d6b7fed8d79 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5142024-12-21T03:00:50.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2a93946c-80a2-4af3-b2f5-ff11d7edea5b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5152024-12-21T03:00:50.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2a93946c-80a2-4af3-b2f5-ff11d7edea5b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5162024-12-21T03:00:50.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2a93946c-80a2-4af3-b2f5-ff11d7edea5b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5172024-12-21T03:00:51.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2049c92a-e2d4-4d04-8b5a-1a6e8d1974fa roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5182024-12-21T03:00:51.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2049c92a-e2d4-4d04-8b5a-1a6e8d1974fa resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5192024-12-21T03:00:51.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2049c92a-e2d4-4d04-8b5a-1a6e8d1974fa response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5202024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
5212024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5222024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
5232024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5242024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
5252024-12-21T03:00:51.837ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = aa6a1816-1ed4-446b-8121-599a04d2c280
5262024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.18\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280"}
5272024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
5282024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
5292024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
5302024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5312024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5322024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
5332024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
5342024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
5352024-12-21T03:00:51.837ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5362024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
5372024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5382024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5392024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5402024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
5412024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5422024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
5432024-12-21T03:00:51.837ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 02:50:51.837753996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5442024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5452024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
5462024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5472024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5482024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
5492024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5502024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
5512024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
5522024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5532024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
5542024-12-21T03:00:51.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
5552024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5562024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5572024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5582024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
5592024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
5602024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5612024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5622024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
5632024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5642024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
5652024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5662024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
5672024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5682024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
5692024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5702024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
5712024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
5722024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
5732024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5742024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5752024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
5762024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5772024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
5782024-12-21T03:00:51.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5792024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5802024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
5812024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5822024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
5832024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5842024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5852024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5862024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5872024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5882024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5892024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5902024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5912024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5922024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5932024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5942024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5952024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5962024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5972024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5982024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5992024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6002024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6012024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6022024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6032024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6042024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6052024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6062024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6072024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6082024-12-21T03:00:51.838ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bf02835-271c-4b1b-a7ae-b005eed1920c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da604828-d4f1-4898-b180-39aa8632768d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1697, tv_nsec: 896705611 } })
6092024-12-21T03:00:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6102024-12-21T03:00:51.838ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d789b63-e234-471f-abd5-426e10c5c6e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1697, tv_nsec: 896738792 } })
6112024-12-21T03:00:51.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
6122024-12-21T03:00:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.203654ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
6132024-12-21T03:00:51.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
6142024-12-21T03:00:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.242294ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
6152024-12-21T03:00:51.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6162024-12-21T03:00:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6172024-12-21T03:00:51.841ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.943906ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6182024-12-21T03:00:51.842ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192024-12-21T03:00:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.693276ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
6202024-12-21T03:00:51.844ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1697, tv_nsec: 902223046 } })
6212024-12-21T03:00:51.844ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
6222024-12-21T03:00:51.844ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 02:50:51.837753996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6232024-12-21T03:00:51.844ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.78355ms iteration = 12 status = {"expiration":"2024-12-21T02:50:51.837753996Z","pruned":[]}
6242024-12-21T03:00:51.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6252024-12-21T03:00:51.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6262024-12-21T03:00:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6272024-12-21T03:00:51.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6282024-12-21T03:00:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6292024-12-21T03:00:51.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6302024-12-21T03:00:51.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-12-21T03:00:51.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6332024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6342024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6352024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6362024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6372024-12-21T03:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6382024-12-21T03:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6392024-12-21T03:00:51.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6402024-12-21T03:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6412024-12-21T03:00:51.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6422024-12-21T03:00:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6432024-12-21T03:00:51.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1697, tv_nsec: 911833468 } })
6442024-12-21T03:00:51.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6452024-12-21T03:00:51.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
6462024-12-21T03:00:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6472024-12-21T03:00:51.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6482024-12-21T03:00:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6492024-12-21T03:00:51.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502024-12-21T03:00:51.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6512024-12-21T03:00:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6522024-12-21T03:00:51.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6532024-12-21T03:00:51.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6542024-12-21T03:00:51.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6552024-12-21T03:00:51.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6562024-12-21T03:00:51.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572024-12-21T03:00:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6582024-12-21T03:00:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6592024-12-21T03:00:51.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6602024-12-21T03:00:51.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6612024-12-21T03:00:51.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622024-12-21T03:00:51.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6632024-12-21T03:00:51.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6642024-12-21T03:00:51.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6652024-12-21T03:00:51.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-12-21T03:00:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
6672024-12-21T03:00:51.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6682024-12-21T03:00:51.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.203558ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
6692024-12-21T03:00:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6702024-12-21T03:00:51.890ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6712024-12-21T03:00:51.890ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6722024-12-21T03:00:51.890ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 52.960849ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6732024-12-21T03:00:51.892ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6742024-12-21T03:00:51.892ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6752024-12-21T03:00:51.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6762024-12-21T03:00:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6772024-12-21T03:00:51.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6782024-12-21T03:00:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6792024-12-21T03:00:51.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802024-12-21T03:00:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6812024-12-21T03:00:51.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6822024-12-21T03:00:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6832024-12-21T03:00:51.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-12-21T03:00:51.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6852024-12-21T03:00:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6862024-12-21T03:00:51.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6872024-12-21T03:00:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6882024-12-21T03:00:51.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-12-21T03:00:51.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6902024-12-21T03:00:51.904ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6912024-12-21T03:00:51.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6922024-12-21T03:00:51.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6932024-12-21T03:00:51.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6942024-12-21T03:00:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6952024-12-21T03:00:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6962024-12-21T03:00:51.906ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6972024-12-21T03:00:51.906ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6982024-12-21T03:00:51.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6992024-12-21T03:00:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7002024-12-21T03:00:51.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7012024-12-21T03:00:51.907ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7022024-12-21T03:00:51.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7032024-12-21T03:00:51.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042024-12-21T03:00:51.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.603267ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7052024-12-21T03:00:51.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7062024-12-21T03:00:51.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7072024-12-21T03:00:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7082024-12-21T03:00:51.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.967458ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
7092024-12-21T03:00:51.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.599241ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7102024-12-21T03:00:51.918ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1697, tv_nsec: 976115209 } })
7112024-12-21T03:00:51.918ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
7122024-12-21T03:00:51.919ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7132024-12-21T03:00:51.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.21722ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7142024-12-21T03:00:51.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
7152024-12-21T03:00:51.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.992223ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
7162024-12-21T03:00:51.924ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.698953ms iteration = 27 status = {"physical_disks_added":0}
7172024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7182024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7192024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7202024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7212024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7222024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7232024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7242024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7252024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7262024-12-21T03:00:51.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7272024-12-21T03:00:51.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-12-21T03:00:51.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-12-21T03:00:51.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7302024-12-21T03:00:51.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7312024-12-21T03:00:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7322024-12-21T03:00:51.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7332024-12-21T03:00:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7342024-12-21T03:00:51.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7352024-12-21T03:00:51.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7362024-12-21T03:00:51.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7372024-12-21T03:00:51.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7382024-12-21T03:00:51.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7392024-12-21T03:00:51.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7402024-12-21T03:00:51.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7412024-12-21T03:00:51.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7422024-12-21T03:00:51.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-12-21T03:00:51.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7442024-12-21T03:00:51.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7452024-12-21T03:00:51.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7462024-12-21T03:00:51.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7472024-12-21T03:00:51.978ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7482024-12-21T03:00:51.978ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7492024-12-21T03:00:51.978ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 140.546112ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7502024-12-21T03:00:51.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-12-21T03:00:51.979ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7522024-12-21T03:00:51.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7532024-12-21T03:00:51.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.510655ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7542024-12-21T03:00:51.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7552024-12-21T03:00:51.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7562024-12-21T03:00:51.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7572024-12-21T03:00:51.983ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7582024-12-21T03:00:51.983ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7592024-12-21T03:00:51.983ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.076264ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7602024-12-21T03:00:51.985ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7612024-12-21T03:00:51.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7622024-12-21T03:00:51.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-12-21T03:00:51.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7642024-12-21T03:00:51.995ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7652024-12-21T03:00:51.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7662024-12-21T03:00:52.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7672024-12-21T03:00:52.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 0 version = 2
7682024-12-21T03:00:52.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7692024-12-21T03:00:52.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7702024-12-21T03:00:52.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-12-21T03:00:52.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-12-21T03:00:52.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7732024-12-21T03:00:52.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7742024-12-21T03:00:52.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7752024-12-21T03:00:52.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
7762024-12-21T03:00:52.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7772024-12-21T03:00:52.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7782024-12-21T03:00:52.019ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 1 version = 2
7792024-12-21T03:00:52.019ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7802024-12-21T03:00:52.019ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 02:49:54.573469 UTC dns_group = external generation = 2
7812024-12-21T03:00:52.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 181.342859ms iteration = 13 status = {"generation":2}
7822024-12-21T03:00:52.020ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.948577ms iteration = 23 status = 0
7832024-12-21T03:00:52.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
7842024-12-21T03:00:52.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7852024-12-21T03:00:52.021ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7862024-12-21T03:00:52.021ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7872024-12-21T03:00:52.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7882024-12-21T03:00:52.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bd2998e-faec-4814-852f-8d10b45d887c", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
7892024-12-21T03:00:52.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7902024-12-21T03:00:52.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7912024-12-21T03:00:52.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7922024-12-21T03:00:52.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932024-12-21T03:00:52.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7942024-12-21T03:00:52.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7952024-12-21T03:00:52.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7962024-12-21T03:00:52.031ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7972024-12-21T03:00:52.031ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7982024-12-21T03:00:52.031ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 02:49:52.719690 UTC dns_group = internal generation = 1
7992024-12-21T03:00:52.031ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 194.132739ms iteration = 13 status = {"generation":1}
8002024-12-21T03:00:52.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 217.964237ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8012024-12-21T03:00:52.059ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
8022024-12-21T03:00:52.059ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 221.520418ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8032024-12-21T03:00:52.059ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T02:49:48.310639Z, time_modified: 2024-12-21T02:49:48.310639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }) }
8042024-12-21T03:00:52.059ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 221.818251ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]}},"default_endpoint":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8052024-12-21T03:00:52.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8062024-12-21T03:00:52.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8072024-12-21T03:00:52.099ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
8082024-12-21T03:00:52.099ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 261.941141ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8092024-12-21T03:00:52.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
8102024-12-21T03:00:52.103ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8112024-12-21T03:00:52.104ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b412fca9-85e3-4056-a77c-267213873915", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8122024-12-21T03:00:52.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8132024-12-21T03:00:52.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8142024-12-21T03:00:52.123ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
8152024-12-21T03:00:52.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8162024-12-21T03:00:52.189ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
8172024-12-21T03:00:52.189ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8182024-12-21T03:00:52.189ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70cda897-7ad8-4541-b865-b820f7ad5ae4", "content-length": "26", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8192024-12-21T03:00:52.189ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8202024-12-21T03:00:52.192ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
8212024-12-21T03:00:52.210ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 372.824146ms iteration = 23 status = {}
8222024-12-21T03:00:52.214ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8232024-12-21T03:00:52.214ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8242024-12-21T03:00:52.215ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebd1939b-2070-4d40-b75c-a0bb3c6339f6", "content-length": "372", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8252024-12-21T03:00:52.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8262024-12-21T03:00:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8272024-12-21T03:00:52.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8282024-12-21T03:00:52.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8292024-12-21T03:00:52.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302024-12-21T03:00:52.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8312024-12-21T03:00:52.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8322024-12-21T03:00:52.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8332024-12-21T03:00:52.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8342024-12-21T03:00:52.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8352024-12-21T03:00:52.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8362024-12-21T03:00:52.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8372024-12-21T03:00:52.270ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8382024-12-21T03:00:52.271ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8392024-12-21T03:00:52.271ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "12e93354-d2b9-4aaf-ac43-0bff4dc9d6bb", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8402024-12-21T03:00:52.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8412024-12-21T03:00:52.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8422024-12-21T03:00:52.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8432024-12-21T03:00:52.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8442024-12-21T03:00:52.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8452024-12-21T03:00:52.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8462024-12-21T03:00:52.282ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8472024-12-21T03:00:52.282ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8482024-12-21T03:00:52.282ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ee223bd7-b6da-498c-b76c-feffc4f0da97", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8492024-12-21T03:00:52.284ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.293135ms iteration = 24 status = {}
8502024-12-21T03:00:52.305ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8512024-12-21T03:00:52.306ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "48ff8613-670f-435f-9b6f-eecc980ce63a", "content-length": "1", "date": "Sat, 21 Dec 2024 03:00:51 GMT"} })
8522024-12-21T03:00:52.308ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8532024-12-21T03:00:52.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8542024-12-21T03:00:52.373ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8552024-12-21T03:00:52.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
8562024-12-21T03:00:52.387ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "05fe53d8-0833-4051-81b3-51e429a30347", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8572024-12-21T03:00:52.387ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8582024-12-21T03:00:52.389ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "82ecc732-ef84-4387-aa3b-c87907f953b8", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8592024-12-21T03:00:52.389ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8602024-12-21T03:00:52.391ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8612024-12-21T03:00:52.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 553.756229ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8622024-12-21T03:00:52.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8632024-12-21T03:00:52.450ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d012853c-fa97-41c0-861b-af58279dbc6c", "content-length": "691", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8642024-12-21T03:00:52.450ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8652024-12-21T03:00:52.450ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8662024-12-21T03:00:52.450ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8672024-12-21T03:00:52.452ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 614.885354ms iteration = 23 status = null
8682024-12-21T03:00:52.454ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 616.558053ms iteration = 23 status = {}
8692024-12-21T03:00:52.472ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8702024-12-21T03:00:52.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "31728306-91f7-480b-95bb-8b45c0b8e52a", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8712024-12-21T03:00:52.473ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8722024-12-21T03:00:52.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7d11a024-05ab-4397-8208-6eae66efb34f", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8732024-12-21T03:00:52.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8742024-12-21T03:00:52.476ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "87a9072e-00ef-49ec-860c-0ef7cc829e7a", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8752024-12-21T03:00:52.476ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8762024-12-21T03:00:52.478ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8772024-12-21T03:00:52.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 640.800847ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8782024-12-21T03:00:52.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 093e48ef-af6f-4aee-82d2-d62de19220c0 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8792024-12-21T03:00:52.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 093e48ef-af6f-4aee-82d2-d62de19220c0 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8802024-12-21T03:00:52.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 093e48ef-af6f-4aee-82d2-d62de19220c0 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8812024-12-21T03:00:52.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8822024-12-21T03:00:52.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8832024-12-21T03:00:52.558ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
8842024-12-21T03:00:52.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8852024-12-21T03:00:52.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8862024-12-21T03:00:52.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8872024-12-21T03:00:52.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9174df93-68e1-40c2-b85b-9e805ae0e0d1", "content-length": "134", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
8882024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8892024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
8902024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8912024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8922024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8932024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8942024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8952024-12-21T03:00:52.567ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8962024-12-21T03:00:52.568ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8972024-12-21T03:00:52.568ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8982024-12-21T03:00:52.568ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
8992024-12-21T03:00:52.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9002024-12-21T03:00:52.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9012024-12-21T03:00:52.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9022024-12-21T03:00:52.571ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5416293d-9f27-4836-9dd0-5c28a4df5178", "content-length": "2", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
9032024-12-21T03:00:52.571ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9042024-12-21T03:00:52.571ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf23cd68-7bc7-4961-9062-575c21fefebb", "content-length": "52", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
9052024-12-21T03:00:52.571ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
9062024-12-21T03:00:52.571ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9072024-12-21T03:00:52.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6b6aa016-afad-46cc-bedb-0f490228ebdf", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
9082024-12-21T03:00:52.666ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
9092024-12-21T03:00:52.666ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9102024-12-21T03:00:52.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "37abe50b-8801-4cc8-9970-e131d2a1c91b", "content-length": "682", "date": "Sat, 21 Dec 2024 03:00:52 GMT"} })
9112024-12-21T03:00:52.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9122024-12-21T03:00:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9132024-12-21T03:00:52.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9142024-12-21T03:00:52.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9152024-12-21T03:00:52.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9162024-12-21T03:00:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9172024-12-21T03:00:52.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9182024-12-21T03:00:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9192024-12-21T03:00:52.686ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 848.758876ms iteration = 23 status = {}
9202024-12-21T03:00:52.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 761dd1e9-10b0-400a-9a2d-4565b46208e0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9212024-12-21T03:00:52.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 761dd1e9-10b0-400a-9a2d-4565b46208e0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9222024-12-21T03:00:53.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 761dd1e9-10b0-400a-9a2d-4565b46208e0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9232024-12-21T03:00:53.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0ad8be1-fecb-4565-8697-eba5953168d2 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9242024-12-21T03:00:53.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0ad8be1-fecb-4565-8697-eba5953168d2 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9252024-12-21T03:00:53.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f0ad8be1-fecb-4565-8697-eba5953168d2 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9262024-12-21T03:00:54.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1432 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 24ea6f03-0dc0-4bf7-9e81-92cd227ce178 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
9272024-12-21T03:00:54.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4030b5a0-dd38-4e7f-8e48-6fa094aadcaa roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9282024-12-21T03:00:54.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4030b5a0-dd38-4e7f-8e48-6fa094aadcaa resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9292024-12-21T03:00:54.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4030b5a0-dd38-4e7f-8e48-6fa094aadcaa response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9302024-12-21T03:00:55.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ab460d52-3388-4e74-a15b-2533454e5591 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9312024-12-21T03:00:55.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ab460d52-3388-4e74-a15b-2533454e5591 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9322024-12-21T03:00:55.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ab460d52-3388-4e74-a15b-2533454e5591 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9332024-12-21T03:00:56.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 89579a7b-9874-49ef-9257-442d7dae5c46 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9342024-12-21T03:00:56.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 89579a7b-9874-49ef-9257-442d7dae5c46 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9352024-12-21T03:00:56.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 89579a7b-9874-49ef-9257-442d7dae5c46 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9362024-12-21T03:00:57.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17cf2387-2958-4589-8ec8-73ce5cfb8c87 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9372024-12-21T03:00:57.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17cf2387-2958-4589-8ec8-73ce5cfb8c87 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9382024-12-21T03:00:57.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17cf2387-2958-4589-8ec8-73ce5cfb8c87 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9392024-12-21T03:00:58.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de7898dd-af9c-4a27-a889-4c72a90b1267 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9402024-12-21T03:00:58.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de7898dd-af9c-4a27-a889-4c72a90b1267 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9412024-12-21T03:00:58.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de7898dd-af9c-4a27-a889-4c72a90b1267 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9422024-12-21T03:00:59.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09f7b38-fc10-42c8-8473-c7d68486a7bb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9432024-12-21T03:00:59.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09f7b38-fc10-42c8-8473-c7d68486a7bb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9442024-12-21T03:00:59.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09f7b38-fc10-42c8-8473-c7d68486a7bb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9452024-12-21T03:01:00.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d744fb64-acd2-43e0-babf-79e8281cc853 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9462024-12-21T03:01:00.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d744fb64-acd2-43e0-babf-79e8281cc853 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9472024-12-21T03:01:00.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d744fb64-acd2-43e0-babf-79e8281cc853 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9482024-12-21T03:01:01.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ba813010-4443-4d24-8cdf-8f25667c72fb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9492024-12-21T03:01:01.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ba813010-4443-4d24-8cdf-8f25667c72fb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9502024-12-21T03:01:01.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ba813010-4443-4d24-8cdf-8f25667c72fb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9512024-12-21T03:01:01.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
9522024-12-21T03:01:01.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
9532024-12-21T03:01:01.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9542024-12-21T03:01:01.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9552024-12-21T03:01:01.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9562024-12-21T03:01:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9572024-12-21T03:01:01.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-12-21T03:01:01.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9592024-12-21T03:01:01.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9602024-12-21T03:01:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9612024-12-21T03:01:01.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9622024-12-21T03:01:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9632024-12-21T03:01:01.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9642024-12-21T03:01:01.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9652024-12-21T03:01:01.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9662024-12-21T03:01:01.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
9672024-12-21T03:01:01.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9682024-12-21T03:01:01.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9692024-12-21T03:01:01.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
9702024-12-21T03:01:01.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.366752ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
9712024-12-21T03:01:01.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.17427ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9722024-12-21T03:01:02.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 542d01cc-7f5b-47b3-b359-b449b78940b1 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9732024-12-21T03:01:02.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 542d01cc-7f5b-47b3-b359-b449b78940b1 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9742024-12-21T03:01:02.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 542d01cc-7f5b-47b3-b359-b449b78940b1 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9752024-12-21T03:01:03.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1cc89c7e-9d61-4b0e-9222-019bd4fded27 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9762024-12-21T03:01:03.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1cc89c7e-9d61-4b0e-9222-019bd4fded27 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9772024-12-21T03:01:03.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1cc89c7e-9d61-4b0e-9222-019bd4fded27 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9782024-12-21T03:01:04.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 03c6c14d-b5a8-41db-92f6-bad161df25a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
9792024-12-21T03:01:04.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 03c6c14d-b5a8-41db-92f6-bad161df25a5 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
9802024-12-21T03:01:04.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 03c6c14d-b5a8-41db-92f6-bad161df25a5 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
9812024-12-21T03:01:04.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 649a4bc4-6b1c-42f0-a7e7-812b3a3fd901 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
9822024-12-21T03:01:04.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 649a4bc4-6b1c-42f0-a7e7-812b3a3fd901 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
9832024-12-21T03:01:04.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 649a4bc4-6b1c-42f0-a7e7-812b3a3fd901 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
9842024-12-21T03:01:04.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1374 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 4fbf57f8-2f4c-479f-ac92-21f47956ae27 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
9852024-12-21T03:01:04.530ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59758
9862024-12-21T03:01:04.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59758 req_id = a89ada38-4b29-4348-adf2-4500e54e6e66 roles = RoleSet { roles: {} } uri = /metrics/producers
9872024-12-21T03:01:04.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59758 req_id = a89ada38-4b29-4348-adf2-4500e54e6e66 resource = Database result = Ok(()) uri = /metrics/producers
9882024-12-21T03:01:04.568ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = eb235eaa-a21c-4e67-bc55-d44f49c3daf8
9892024-12-21T03:01:04.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37706 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59758 req_id = a89ada38-4b29-4348-adf2-4500e54e6e66 response_code = 201 uri = /metrics/producers
9902024-12-21T03:01:04.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 561553df-261a-4ffe-ac18-51febed5bc0a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9912024-12-21T03:01:04.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 561553df-261a-4ffe-ac18-51febed5bc0a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9922024-12-21T03:01:04.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 561553df-261a-4ffe-ac18-51febed5bc0a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9932024-12-21T03:01:05.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb3a0e5d-c9e2-4062-8b6b-7d1c828c0157 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9942024-12-21T03:01:05.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb3a0e5d-c9e2-4062-8b6b-7d1c828c0157 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9952024-12-21T03:01:05.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb3a0e5d-c9e2-4062-8b6b-7d1c828c0157 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9962024-12-21T03:01:06.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 76bd1be0-6cc9-4952-9a55-fe3b2963fb67 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9972024-12-21T03:01:06.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 76bd1be0-6cc9-4952-9a55-fe3b2963fb67 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9982024-12-21T03:01:06.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 76bd1be0-6cc9-4952-9a55-fe3b2963fb67 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9992024-12-21T03:01:07.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ad649bb-962d-44d7-9f40-7519e2e0bb16 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10002024-12-21T03:01:07.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ad649bb-962d-44d7-9f40-7519e2e0bb16 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10012024-12-21T03:01:07.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ad649bb-962d-44d7-9f40-7519e2e0bb16 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10022024-12-21T03:01:08.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 493a9414-78d4-4827-8471-f757293ad731 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10032024-12-21T03:01:08.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 493a9414-78d4-4827-8471-f757293ad731 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10042024-12-21T03:01:08.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 493a9414-78d4-4827-8471-f757293ad731 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10052024-12-21T03:01:09.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d9581d83-6a4a-4e6c-aa3d-fa0bfa39aee9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10062024-12-21T03:01:09.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d9581d83-6a4a-4e6c-aa3d-fa0bfa39aee9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10072024-12-21T03:01:09.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d9581d83-6a4a-4e6c-aa3d-fa0bfa39aee9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10082024-12-21T03:01:10.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 55cb86ff-232d-42cb-8021-64eb03ab4c3b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10092024-12-21T03:01:10.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 55cb86ff-232d-42cb-8021-64eb03ab4c3b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10102024-12-21T03:01:10.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 55cb86ff-232d-42cb-8021-64eb03ab4c3b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10112024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
10122024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10132024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
10142024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10152024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10162024-12-21T03:01:11.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10172024-12-21T03:01:11.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10182024-12-21T03:01:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10192024-12-21T03:01:11.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10202024-12-21T03:01:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10212024-12-21T03:01:11.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10222024-12-21T03:01:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10232024-12-21T03:01:11.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10242024-12-21T03:01:11.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10252024-12-21T03:01:11.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-12-21T03:01:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
10272024-12-21T03:01:11.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10282024-12-21T03:01:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10292024-12-21T03:01:11.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
10302024-12-21T03:01:11.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.949068ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
10312024-12-21T03:01:11.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.013362ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10322024-12-21T03:01:11.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1f3ca431-cb0e-43a7-a580-d127ea12a4a2 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10332024-12-21T03:01:11.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1f3ca431-cb0e-43a7-a580-d127ea12a4a2 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10342024-12-21T03:01:11.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1f3ca431-cb0e-43a7-a580-d127ea12a4a2 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10352024-12-21T03:01:12.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e00ac070-299f-47cd-94d6-58dc99299059 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10362024-12-21T03:01:12.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e00ac070-299f-47cd-94d6-58dc99299059 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10372024-12-21T03:01:12.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e00ac070-299f-47cd-94d6-58dc99299059 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10382024-12-21T03:01:13.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6c37f902-a2bc-4633-95dc-48562db3b82f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10392024-12-21T03:01:13.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6c37f902-a2bc-4633-95dc-48562db3b82f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10402024-12-21T03:01:13.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6c37f902-a2bc-4633-95dc-48562db3b82f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10412024-12-21T03:01:14.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 8bbb35f5-bc75-41e7-b1c3-ec0c2db841a7 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
10422024-12-21T03:01:14.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0915f58d-791f-496c-9627-126f2ed9d81c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10432024-12-21T03:01:14.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0915f58d-791f-496c-9627-126f2ed9d81c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10442024-12-21T03:01:14.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0915f58d-791f-496c-9627-126f2ed9d81c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10452024-12-21T03:01:16.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c820eff9-1188-4993-8957-5e664b5cacc7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10462024-12-21T03:01:16.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c820eff9-1188-4993-8957-5e664b5cacc7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10472024-12-21T03:01:16.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c820eff9-1188-4993-8957-5e664b5cacc7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10482024-12-21T03:01:17.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4904fd0b-6d41-423d-abd9-77b626f0a0dc roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10492024-12-21T03:01:17.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4904fd0b-6d41-423d-abd9-77b626f0a0dc resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10502024-12-21T03:01:17.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4904fd0b-6d41-423d-abd9-77b626f0a0dc response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10512024-12-21T03:01:18.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeabbd9-441a-45e3-83ba-af1acfd993d5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10522024-12-21T03:01:18.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeabbd9-441a-45e3-83ba-af1acfd993d5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10532024-12-21T03:01:18.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeabbd9-441a-45e3-83ba-af1acfd993d5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10542024-12-21T03:01:19.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 66e57316-389e-4805-a82f-c258089707df roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10552024-12-21T03:01:19.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 66e57316-389e-4805-a82f-c258089707df resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10562024-12-21T03:01:19.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 66e57316-389e-4805-a82f-c258089707df response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10572024-12-21T03:01:20.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5c24ca27-1756-43b3-ad23-d0e35835b40f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10582024-12-21T03:01:20.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5c24ca27-1756-43b3-ad23-d0e35835b40f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10592024-12-21T03:01:20.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5c24ca27-1756-43b3-ad23-d0e35835b40f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10602024-12-21T03:01:21.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 08a73df1-8838-4393-a0f1-4c53dfc91bcb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10612024-12-21T03:01:21.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 08a73df1-8838-4393-a0f1-4c53dfc91bcb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10622024-12-21T03:01:21.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 08a73df1-8838-4393-a0f1-4c53dfc91bcb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10632024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
10642024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10652024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
10662024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10672024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10682024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
10692024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
10702024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10712024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
10722024-12-21T03:01:21.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10732024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10742024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
10752024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10762024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
10772024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10782024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10792024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
10802024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10812024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
10822024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10832024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
10842024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
10852024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10862024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10872024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
10882024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10892024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
10902024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10912024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
10922024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
10932024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
10942024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10952024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10962024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
10972024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
10982024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10992024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11002024-12-21T03:01:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11012024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11022024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11032024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11042024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11052024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11062024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11072024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11082024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11092024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11102024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11112024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11122024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11132024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11142024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11152024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11162024-12-21T03:01:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11172024-12-21T03:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11182024-12-21T03:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11192024-12-21T03:01:21.842ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.038167ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11202024-12-21T03:01:21.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212024-12-21T03:01:21.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222024-12-21T03:01:21.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.345473ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
11232024-12-21T03:01:21.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1727, tv_nsec: 902770802 } })
11242024-12-21T03:01:21.845ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
11252024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11262024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11272024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11282024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11292024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11302024-12-21T03:01:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11312024-12-21T03:01:21.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1727, tv_nsec: 907035472 } })
11322024-12-21T03:01:21.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
11332024-12-21T03:01:21.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1727, tv_nsec: 913668629 } })
11342024-12-21T03:01:21.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
11352024-12-21T03:01:21.877ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11362024-12-21T03:01:21.877ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11372024-12-21T03:01:21.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11382024-12-21T03:01:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11392024-12-21T03:01:21.881ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11402024-12-21T03:01:21.881ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11412024-12-21T03:01:21.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11422024-12-21T03:01:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11432024-12-21T03:01:21.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442024-12-21T03:01:21.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11452024-12-21T03:01:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11462024-12-21T03:01:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11472024-12-21T03:01:21.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11482024-12-21T03:01:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11492024-12-21T03:01:21.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11502024-12-21T03:01:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-12-21T03:01:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11522024-12-21T03:01:21.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.417489ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11532024-12-21T03:01:21.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11542024-12-21T03:01:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11552024-12-21T03:01:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11562024-12-21T03:01:21.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11572024-12-21T03:01:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11582024-12-21T03:01:21.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11592024-12-21T03:01:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11602024-12-21T03:01:21.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11612024-12-21T03:01:21.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11622024-12-21T03:01:21.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632024-12-21T03:01:21.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.953869ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11642024-12-21T03:01:21.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-12-21T03:01:21.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-12-21T03:01:21.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11672024-12-21T03:01:21.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11682024-12-21T03:01:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11692024-12-21T03:01:21.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702024-12-21T03:01:21.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.801504ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
11712024-12-21T03:01:21.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-12-21T03:01:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11732024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11742024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11752024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11762024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11772024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11782024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
11792024-12-21T03:01:21.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11802024-12-21T03:01:21.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11812024-12-21T03:01:21.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11822024-12-21T03:01:21.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11832024-12-21T03:01:21.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11842024-12-21T03:01:21.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11852024-12-21T03:01:21.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11862024-12-21T03:01:21.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11872024-12-21T03:01:21.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11882024-12-21T03:01:21.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11892024-12-21T03:01:21.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11902024-12-21T03:01:21.940ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11912024-12-21T03:01:21.940ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11922024-12-21T03:01:21.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.685348ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11932024-12-21T03:01:21.942ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
11942024-12-21T03:01:21.942ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.470531ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
11952024-12-21T03:01:21.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11962024-12-21T03:01:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11972024-12-21T03:01:21.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.938647ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11982024-12-21T03:01:21.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
11992024-12-21T03:01:21.966ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12002024-12-21T03:01:21.966ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d8e7f6-77c4-49a9-9e1f-8b48221541da", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:21 GMT"} })
12012024-12-21T03:01:21.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12022024-12-21T03:01:21.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12032024-12-21T03:01:21.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12042024-12-21T03:01:21.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12052024-12-21T03:01:21.976ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062024-12-21T03:01:21.979ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12072024-12-21T03:01:21.979ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.911536ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12082024-12-21T03:01:21.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12092024-12-21T03:01:21.979ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102024-12-21T03:01:21.979ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12112024-12-21T03:01:21.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12122024-12-21T03:01:21.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-12-21T03:01:21.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12142024-12-21T03:01:21.982ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12152024-12-21T03:01:21.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12162024-12-21T03:01:21.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
12172024-12-21T03:01:21.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12182024-12-21T03:01:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12192024-12-21T03:01:21.986ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.723336ms iteration = 24 status = 0
12202024-12-21T03:01:21.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.944621ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12212024-12-21T03:01:21.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12222024-12-21T03:01:21.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12232024-12-21T03:01:22.011ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
12242024-12-21T03:01:22.011ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 172.650257ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
12252024-12-21T03:01:22.041ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
12262024-12-21T03:01:22.041ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12272024-12-21T03:01:22.042ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b256fa6c-9a84-43c7-9e59-c48d66d700a5", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:21 GMT"} })
12282024-12-21T03:01:22.042ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12292024-12-21T03:01:22.042ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
12302024-12-21T03:01:22.042ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12312024-12-21T03:01:22.043ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28260531-3c12-49a0-9423-b3aeef0ba4bd", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:21 GMT"} })
12322024-12-21T03:01:22.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12332024-12-21T03:01:22.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12342024-12-21T03:01:22.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
12352024-12-21T03:01:22.080ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.37339ms iteration = 28 status = {"physical_disks_added":0}
12362024-12-21T03:01:22.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12372024-12-21T03:01:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12382024-12-21T03:01:22.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392024-12-21T03:01:22.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12402024-12-21T03:01:22.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12412024-12-21T03:01:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12422024-12-21T03:01:22.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12432024-12-21T03:01:22.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12442024-12-21T03:01:22.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12452024-12-21T03:01:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12462024-12-21T03:01:22.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fc91ee62-99a3-4f8b-b21a-ba809c631d07 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
12472024-12-21T03:01:22.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fc91ee62-99a3-4f8b-b21a-ba809c631d07 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
12482024-12-21T03:01:22.149ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 311.122375ms iteration = 24 status = {}
12492024-12-21T03:01:22.161ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12502024-12-21T03:01:22.162ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b17d110-c4a3-4c08-8d5e-62536abca693", "content-length": "1", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12512024-12-21T03:01:22.163ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12522024-12-21T03:01:22.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12532024-12-21T03:01:22.177ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12542024-12-21T03:01:22.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12552024-12-21T03:01:22.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8033e2a1-516b-4e79-a47c-56d4b97cb474", "content-length": "372", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12562024-12-21T03:01:22.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12572024-12-21T03:01:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12582024-12-21T03:01:22.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fc91ee62-99a3-4f8b-b21a-ba809c631d07 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
12592024-12-21T03:01:22.180ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 342.200518ms iteration = 24 status = null
12602024-12-21T03:01:22.227ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12612024-12-21T03:01:22.227ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12622024-12-21T03:01:22.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "deb2b28f-a037-4f8e-9bfc-2620a288bd7e", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12632024-12-21T03:01:22.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12642024-12-21T03:01:22.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12652024-12-21T03:01:22.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12662024-12-21T03:01:22.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12672024-12-21T03:01:22.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12682024-12-21T03:01:22.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12692024-12-21T03:01:22.236ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12702024-12-21T03:01:22.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12712024-12-21T03:01:22.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "61d4863c-87e3-4a86-88ea-93cf3cf69b81", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12722024-12-21T03:01:22.239ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.60907ms iteration = 25 status = {}
12732024-12-21T03:01:22.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12742024-12-21T03:01:22.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12752024-12-21T03:01:22.245ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
12762024-12-21T03:01:22.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12772024-12-21T03:01:22.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12782024-12-21T03:01:22.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12792024-12-21T03:01:22.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "43b1a843-8bce-4364-a136-a7211dbd4d66", "content-length": "134", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12802024-12-21T03:01:22.255ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12812024-12-21T03:01:22.255ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
12822024-12-21T03:01:22.255ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12832024-12-21T03:01:22.255ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12842024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12852024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12862024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12872024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12882024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12892024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12902024-12-21T03:01:22.256ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
12912024-12-21T03:01:22.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12922024-12-21T03:01:22.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12932024-12-21T03:01:22.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12942024-12-21T03:01:22.258ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed3fb3b-00f6-4da5-aece-cf2ebd86d7f8", "content-length": "2", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12952024-12-21T03:01:22.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12962024-12-21T03:01:22.258ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d26b859-9c0f-4cfe-b44f-94cb8a0bafdf", "content-length": "52", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
12972024-12-21T03:01:22.258ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
12982024-12-21T03:01:22.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12992024-12-21T03:01:22.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13002024-12-21T03:01:22.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a116e68-0984-452e-9b1e-ef2bf946a659", "content-length": "691", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
13012024-12-21T03:01:22.339ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
13022024-12-21T03:01:22.339ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13032024-12-21T03:01:22.339ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13042024-12-21T03:01:22.341ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 503.156649ms iteration = 24 status = {}
13052024-12-21T03:01:22.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "343e8e73-aed4-48b8-b202-6850a602665b", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
13062024-12-21T03:01:22.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
13072024-12-21T03:01:22.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13082024-12-21T03:01:22.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "63e80ae8-6f32-4e93-8188-0fa596d9c025", "content-length": "682", "date": "Sat, 21 Dec 2024 03:01:22 GMT"} })
13092024-12-21T03:01:22.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13102024-12-21T03:01:22.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13112024-12-21T03:01:22.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13122024-12-21T03:01:22.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13132024-12-21T03:01:22.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142024-12-21T03:01:22.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13152024-12-21T03:01:22.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13162024-12-21T03:01:22.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13172024-12-21T03:01:22.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 631.174444ms iteration = 24 status = {}
13182024-12-21T03:01:23.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = bdd3d071-a3c4-415e-af88-90bb82f9b6a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13192024-12-21T03:01:23.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = bdd3d071-a3c4-415e-af88-90bb82f9b6a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13202024-12-21T03:01:23.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = bdd3d071-a3c4-415e-af88-90bb82f9b6a1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13212024-12-21T03:01:23.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a99f7739-3d63-4d29-a4a4-f426abceea33 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13222024-12-21T03:01:23.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a99f7739-3d63-4d29-a4a4-f426abceea33 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13232024-12-21T03:01:23.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a99f7739-3d63-4d29-a4a4-f426abceea33 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13242024-12-21T03:01:24.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1450 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = f0b14091-e3f9-467f-a1b3-b606e62710b4 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
13252024-12-21T03:01:24.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4d57f97f-7bdd-4f56-a29b-bd81cc7bd4c7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13262024-12-21T03:01:24.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4d57f97f-7bdd-4f56-a29b-bd81cc7bd4c7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13272024-12-21T03:01:24.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4d57f97f-7bdd-4f56-a29b-bd81cc7bd4c7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13282024-12-21T03:01:25.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0fdca6ad-4abe-43c8-90f0-42c1cffb0224 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13292024-12-21T03:01:25.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0fdca6ad-4abe-43c8-90f0-42c1cffb0224 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13302024-12-21T03:01:25.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0fdca6ad-4abe-43c8-90f0-42c1cffb0224 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13312024-12-21T03:01:26.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeafa30-4181-47fa-b8ea-e66c4fd9d953 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13322024-12-21T03:01:26.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeafa30-4181-47fa-b8ea-e66c4fd9d953 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13332024-12-21T03:01:26.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8eeafa30-4181-47fa-b8ea-e66c4fd9d953 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13342024-12-21T03:01:27.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3858003-add0-485c-bb03-cfca39461876 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13352024-12-21T03:01:27.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3858003-add0-485c-bb03-cfca39461876 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13362024-12-21T03:01:27.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3858003-add0-485c-bb03-cfca39461876 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13372024-12-21T03:01:28.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c812a09a-d677-4ddf-8a41-2aeb85322a3b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13382024-12-21T03:01:28.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c812a09a-d677-4ddf-8a41-2aeb85322a3b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13392024-12-21T03:01:28.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c812a09a-d677-4ddf-8a41-2aeb85322a3b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13402024-12-21T03:01:29.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee533d49-c41b-4209-a967-99ea266c4af1 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13412024-12-21T03:01:29.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee533d49-c41b-4209-a967-99ea266c4af1 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13422024-12-21T03:01:29.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ee533d49-c41b-4209-a967-99ea266c4af1 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13432024-12-21T03:01:30.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f569c7de-8acc-48eb-9e44-2543c649e246 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13442024-12-21T03:01:30.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f569c7de-8acc-48eb-9e44-2543c649e246 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13452024-12-21T03:01:30.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f569c7de-8acc-48eb-9e44-2543c649e246 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13462024-12-21T03:01:31.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 45854597-a05c-400b-8c6a-49c022e488c2 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13472024-12-21T03:01:31.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 45854597-a05c-400b-8c6a-49c022e488c2 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13482024-12-21T03:01:31.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 45854597-a05c-400b-8c6a-49c022e488c2 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13492024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
13502024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13512024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
13522024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13532024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13542024-12-21T03:01:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552024-12-21T03:01:31.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562024-12-21T03:01:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13572024-12-21T03:01:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13582024-12-21T03:01:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13592024-12-21T03:01:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13602024-12-21T03:01:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13612024-12-21T03:01:31.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622024-12-21T03:01:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
13632024-12-21T03:01:31.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13642024-12-21T03:01:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13652024-12-21T03:01:31.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
13662024-12-21T03:01:31.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.200275ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
13672024-12-21T03:01:31.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13682024-12-21T03:01:31.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13692024-12-21T03:01:31.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.09471ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13702024-12-21T03:01:32.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e6132121-c2e1-403c-9863-93d33ee657db roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13712024-12-21T03:01:32.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e6132121-c2e1-403c-9863-93d33ee657db resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13722024-12-21T03:01:32.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e6132121-c2e1-403c-9863-93d33ee657db response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13732024-12-21T03:01:33.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97f6631a-b1ca-440d-b444-541797f10a51 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13742024-12-21T03:01:33.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97f6631a-b1ca-440d-b444-541797f10a51 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13752024-12-21T03:01:33.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 97f6631a-b1ca-440d-b444-541797f10a51 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13762024-12-21T03:01:34.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 3ea5bc2a-d632-4a98-9006-e840202ce41b roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
13772024-12-21T03:01:34.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 3ea5bc2a-d632-4a98-9006-e840202ce41b resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
13782024-12-21T03:01:34.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 3ea5bc2a-d632-4a98-9006-e840202ce41b response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
13792024-12-21T03:01:34.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 07d17aeb-a90a-46c4-a3a8-1762a8ef9e50 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
13802024-12-21T03:01:34.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 07d17aeb-a90a-46c4-a3a8-1762a8ef9e50 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
13812024-12-21T03:01:34.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 07d17aeb-a90a-46c4-a3a8-1762a8ef9e50 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
13822024-12-21T03:01:34.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1408 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 98d6fea1-86ba-4dde-b19b-7d85a7507901 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
13832024-12-21T03:01:34.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c7f8353-fa50-4876-97c0-f93c8808ea81 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13842024-12-21T03:01:34.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c7f8353-fa50-4876-97c0-f93c8808ea81 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13852024-12-21T03:01:34.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c7f8353-fa50-4876-97c0-f93c8808ea81 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13862024-12-21T03:01:35.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fe7a7c88-49b3-45be-98f4-22bc0ffccc26 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13872024-12-21T03:01:35.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fe7a7c88-49b3-45be-98f4-22bc0ffccc26 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13882024-12-21T03:01:35.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fe7a7c88-49b3-45be-98f4-22bc0ffccc26 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13892024-12-21T03:01:36.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d61e09b7-9332-4eb3-8d4c-ff4b3d189a6b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13902024-12-21T03:01:36.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d61e09b7-9332-4eb3-8d4c-ff4b3d189a6b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13912024-12-21T03:01:36.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d61e09b7-9332-4eb3-8d4c-ff4b3d189a6b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13922024-12-21T03:01:37.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b199b9b6-972a-4376-af48-ac5e84f286d7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13932024-12-21T03:01:37.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b199b9b6-972a-4376-af48-ac5e84f286d7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13942024-12-21T03:01:37.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b199b9b6-972a-4376-af48-ac5e84f286d7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13952024-12-21T03:01:38.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8513e53e-f980-4c7b-8b13-6546c7f6787f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13962024-12-21T03:01:38.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8513e53e-f980-4c7b-8b13-6546c7f6787f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13972024-12-21T03:01:38.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8513e53e-f980-4c7b-8b13-6546c7f6787f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13982024-12-21T03:01:39.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6d273480-98c6-4e85-8dd7-efd2b5b68704 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
13992024-12-21T03:01:39.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6d273480-98c6-4e85-8dd7-efd2b5b68704 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14002024-12-21T03:01:39.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6d273480-98c6-4e85-8dd7-efd2b5b68704 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14012024-12-21T03:01:40.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 86ca0aa5-8077-4cfe-9307-a89f5e3d9ab9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14022024-12-21T03:01:40.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 86ca0aa5-8077-4cfe-9307-a89f5e3d9ab9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14032024-12-21T03:01:40.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 86ca0aa5-8077-4cfe-9307-a89f5e3d9ab9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14042024-12-21T03:01:41.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d0420f-850a-49fb-a70b-b6523a9bf63e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14052024-12-21T03:01:41.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d0420f-850a-49fb-a70b-b6523a9bf63e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14062024-12-21T03:01:41.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 56d0420f-850a-49fb-a70b-b6523a9bf63e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14072024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
14082024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
14092024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14102024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14112024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14122024-12-21T03:01:41.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14132024-12-21T03:01:41.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14142024-12-21T03:01:41.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-12-21T03:01:41.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14162024-12-21T03:01:41.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.33163ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14172024-12-21T03:01:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14182024-12-21T03:01:41.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192024-12-21T03:01:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202024-12-21T03:01:41.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14212024-12-21T03:01:41.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14222024-12-21T03:01:41.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232024-12-21T03:01:41.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
14242024-12-21T03:01:41.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14252024-12-21T03:01:41.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14262024-12-21T03:01:41.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
14272024-12-21T03:01:41.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.692695ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
14282024-12-21T03:01:42.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2e163f0e-37cc-4319-822d-a470d09c07f8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14292024-12-21T03:01:42.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2e163f0e-37cc-4319-822d-a470d09c07f8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14302024-12-21T03:01:42.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2e163f0e-37cc-4319-822d-a470d09c07f8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14312024-12-21T03:01:43.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4c17823d-b1db-4d97-b04a-be452fc6f3f3 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14322024-12-21T03:01:43.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4c17823d-b1db-4d97-b04a-be452fc6f3f3 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14332024-12-21T03:01:43.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4c17823d-b1db-4d97-b04a-be452fc6f3f3 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14342024-12-21T03:01:44.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = af9e383b-e2ef-454a-a9f7-067f9f312901 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
14352024-12-21T03:01:44.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ddb78b5b-feed-49ca-85e2-35771fc7c5cc roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14362024-12-21T03:01:44.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ddb78b5b-feed-49ca-85e2-35771fc7c5cc resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14372024-12-21T03:01:44.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ddb78b5b-feed-49ca-85e2-35771fc7c5cc response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14382024-12-21T03:01:45.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e74e87ab-14a4-49a9-b51d-d3a3e1569e2e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14392024-12-21T03:01:45.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e74e87ab-14a4-49a9-b51d-d3a3e1569e2e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14402024-12-21T03:01:45.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e74e87ab-14a4-49a9-b51d-d3a3e1569e2e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14412024-12-21T03:01:46.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b2a6425-e755-4bc2-9ff2-fcbe1011ddc9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14422024-12-21T03:01:46.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b2a6425-e755-4bc2-9ff2-fcbe1011ddc9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14432024-12-21T03:01:46.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b2a6425-e755-4bc2-9ff2-fcbe1011ddc9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14442024-12-21T03:01:47.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c942467c-68a3-412a-a5fd-554d2872f2af roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14452024-12-21T03:01:47.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c942467c-68a3-412a-a5fd-554d2872f2af resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14462024-12-21T03:01:47.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c942467c-68a3-412a-a5fd-554d2872f2af response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14472024-12-21T03:01:48.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 975c352e-0bae-4a6e-a9c4-a26b620c79ab roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14482024-12-21T03:01:48.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 975c352e-0bae-4a6e-a9c4-a26b620c79ab resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14492024-12-21T03:01:48.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 975c352e-0bae-4a6e-a9c4-a26b620c79ab response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14502024-12-21T03:01:49.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 45cd340f-d632-417c-9966-a4695e438fd0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14512024-12-21T03:01:49.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 45cd340f-d632-417c-9966-a4695e438fd0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14522024-12-21T03:01:49.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 45cd340f-d632-417c-9966-a4695e438fd0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14532024-12-21T03:01:49.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = c016d21c-5f5e-4cac-ab1d-9245f65b0ee4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
14542024-12-21T03:01:49.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = c016d21c-5f5e-4cac-ab1d-9245f65b0ee4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
14552024-12-21T03:01:49.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = c016d21c-5f5e-4cac-ab1d-9245f65b0ee4 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
14562024-12-21T03:01:49.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 22b5b7e1-5fc6-45e7-be9b-ea535f7c9a8b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14572024-12-21T03:01:49.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 22b5b7e1-5fc6-45e7-be9b-ea535f7c9a8b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14582024-12-21T03:01:49.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 22b5b7e1-5fc6-45e7-be9b-ea535f7c9a8b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14592024-12-21T03:01:50.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 495f7629-cd72-4c30-91d8-f9d912209ed2 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14602024-12-21T03:01:50.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 495f7629-cd72-4c30-91d8-f9d912209ed2 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14612024-12-21T03:01:50.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 495f7629-cd72-4c30-91d8-f9d912209ed2 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14622024-12-21T03:01:51.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 87ba4555-9e30-4388-a3de-a72f446b9dd6 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14632024-12-21T03:01:51.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 87ba4555-9e30-4388-a3de-a72f446b9dd6 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14642024-12-21T03:01:51.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 87ba4555-9e30-4388-a3de-a72f446b9dd6 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
14652024-12-21T03:01:51.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
14662024-12-21T03:01:51.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
14672024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
14682024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14692024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14702024-12-21T03:01:51.838ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = aa6a1816-1ed4-446b-8121-599a04d2c280
14712024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.39\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280"}
14722024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
14732024-12-21T03:01:51.838ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14742024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
14752024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
14762024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14772024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14782024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14792024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
14802024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
14812024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
14822024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14832024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14842024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14852024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
14862024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14872024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
14882024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
14892024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14902024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14912024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
14922024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
14932024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14942024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14952024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
14962024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14972024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14982024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
14992024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15002024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
15012024-12-21T03:01:51.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15022024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
15032024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15042024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15052024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
15062024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15072024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
15082024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15092024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
15102024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
15112024-12-21T03:01:51.838ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 02:51:51.838335177 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
15122024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
15132024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
15142024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
15152024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
15162024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15172024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
15182024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15192024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15202024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
15212024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15222024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
15232024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15242024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
15252024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
15262024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15272024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
15282024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15292024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15302024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
15312024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
15322024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15332024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15342024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15352024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15362024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15372024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15382024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15392024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15402024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15412024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15422024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15432024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15442024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15452024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15462024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15472024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15482024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15492024-12-21T03:01:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15502024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15512024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15522024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15532024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15542024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15552024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15562024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15572024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15582024-12-21T03:01:51.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bf02835-271c-4b1b-a7ae-b005eed1920c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da604828-d4f1-4898-b180-39aa8632768d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 896649601 } })
15592024-12-21T03:01:51.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d789b63-e234-471f-abd5-426e10c5c6e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 896656071 } })
15602024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15612024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15622024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15632024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15642024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15652024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15662024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15672024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.235094ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15682024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
15692024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.358836ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
15702024-12-21T03:01:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15712024-12-21T03:01:51.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.587062ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
15722024-12-21T03:01:51.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-12-21T03:01:51.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-12-21T03:01:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.482894ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15752024-12-21T03:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15762024-12-21T03:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772024-12-21T03:01:51.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15782024-12-21T03:01:51.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15792024-12-21T03:01:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15802024-12-21T03:01:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15812024-12-21T03:01:51.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15822024-12-21T03:01:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15832024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15842024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15852024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15862024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15872024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15882024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15892024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15902024-12-21T03:01:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15912024-12-21T03:01:51.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15922024-12-21T03:01:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15932024-12-21T03:01:51.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15942024-12-21T03:01:51.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15952024-12-21T03:01:51.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 911938399 } })
15962024-12-21T03:01:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15972024-12-21T03:01:51.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
15982024-12-21T03:01:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15992024-12-21T03:01:51.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16002024-12-21T03:01:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16012024-12-21T03:01:51.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 914605870 } })
16022024-12-21T03:01:51.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
16032024-12-21T03:01:51.858ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 02:51:51.838335177 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16042024-12-21T03:01:51.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.886512ms iteration = 13 status = {"expiration":"2024-12-21T02:51:51.838335177Z","pruned":[]}
16052024-12-21T03:01:51.859ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16062024-12-21T03:01:51.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16072024-12-21T03:01:51.861ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.147791ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
16082024-12-21T03:01:51.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16092024-12-21T03:01:51.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16102024-12-21T03:01:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16112024-12-21T03:01:51.862ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16122024-12-21T03:01:51.862ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16132024-12-21T03:01:51.862ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.568377ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
16142024-12-21T03:01:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16152024-12-21T03:01:51.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16162024-12-21T03:01:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16172024-12-21T03:01:51.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16182024-12-21T03:01:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16192024-12-21T03:01:51.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202024-12-21T03:01:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16212024-12-21T03:01:51.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16222024-12-21T03:01:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16232024-12-21T03:01:51.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242024-12-21T03:01:51.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16252024-12-21T03:01:51.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16262024-12-21T03:01:51.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16272024-12-21T03:01:51.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16282024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16292024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16302024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16312024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16322024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332024-12-21T03:01:51.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16342024-12-21T03:01:51.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16352024-12-21T03:01:51.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16362024-12-21T03:01:51.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16372024-12-21T03:01:51.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16382024-12-21T03:01:51.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16392024-12-21T03:01:51.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16402024-12-21T03:01:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16412024-12-21T03:01:51.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16422024-12-21T03:01:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16432024-12-21T03:01:51.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442024-12-21T03:01:51.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16452024-12-21T03:01:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16462024-12-21T03:01:51.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16472024-12-21T03:01:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16482024-12-21T03:01:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16492024-12-21T03:01:51.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502024-12-21T03:01:51.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16512024-12-21T03:01:51.904ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16522024-12-21T03:01:51.904ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16532024-12-21T03:01:51.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16542024-12-21T03:01:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16552024-12-21T03:01:51.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16562024-12-21T03:01:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16572024-12-21T03:01:51.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16582024-12-21T03:01:51.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16592024-12-21T03:01:51.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.738433ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
16602024-12-21T03:01:51.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16612024-12-21T03:01:51.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16622024-12-21T03:01:51.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16632024-12-21T03:01:51.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16642024-12-21T03:01:51.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-12-21T03:01:51.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
16662024-12-21T03:01:51.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672024-12-21T03:01:51.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682024-12-21T03:01:51.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16692024-12-21T03:01:51.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16702024-12-21T03:01:51.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16712024-12-21T03:01:51.921ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 83.136971ms iteration = 6 status = {"nsuccess":5}
16722024-12-21T03:01:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16732024-12-21T03:01:51.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16742024-12-21T03:01:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16752024-12-21T03:01:51.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-12-21T03:01:51.928ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16772024-12-21T03:01:51.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16782024-12-21T03:01:51.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.42986ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16792024-12-21T03:01:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16802024-12-21T03:01:51.931ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16812024-12-21T03:01:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16822024-12-21T03:01:51.934ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 992385649 } })
16832024-12-21T03:01:51.935ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
16842024-12-21T03:01:51.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16852024-12-21T03:01:51.935ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16862024-12-21T03:01:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16872024-12-21T03:01:51.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16882024-12-21T03:01:51.943ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16892024-12-21T03:01:51.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16902024-12-21T03:01:51.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16912024-12-21T03:01:51.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16922024-12-21T03:01:51.948ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16932024-12-21T03:01:51.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16942024-12-21T03:01:51.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16952024-12-21T03:01:51.959ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
16962024-12-21T03:01:51.960ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.923055ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
16972024-12-21T03:01:51.973ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16982024-12-21T03:01:51.973ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16992024-12-21T03:01:51.973ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17002024-12-21T03:01:51.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17012024-12-21T03:01:51.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17022024-12-21T03:01:51.974ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17032024-12-21T03:01:51.974ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17042024-12-21T03:01:51.974ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17052024-12-21T03:01:51.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17062024-12-21T03:01:51.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17072024-12-21T03:01:51.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17082024-12-21T03:01:51.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17092024-12-21T03:01:51.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17102024-12-21T03:01:51.978ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17112024-12-21T03:01:51.978ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17122024-12-21T03:01:51.978ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 140.539432ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17132024-12-21T03:01:51.981ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17142024-12-21T03:01:51.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17152024-12-21T03:01:51.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17162024-12-21T03:01:51.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17172024-12-21T03:01:51.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17182024-12-21T03:01:51.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17192024-12-21T03:01:51.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17202024-12-21T03:01:51.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17212024-12-21T03:01:51.993ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17222024-12-21T03:01:51.993ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17232024-12-21T03:01:51.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17242024-12-21T03:01:51.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17252024-12-21T03:01:52.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17262024-12-21T03:01:52.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17272024-12-21T03:01:52.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 168.404048ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17282024-12-21T03:01:52.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 176.117047ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17292024-12-21T03:01:52.014ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17302024-12-21T03:01:52.014ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17312024-12-21T03:01:52.014ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c867835-2d04-4d54-bfc4-f7eff375cb3f", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
17322024-12-21T03:01:52.014ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17332024-12-21T03:01:52.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17342024-12-21T03:01:52.017ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T02:49:48.310639Z, time_modified: 2024-12-21T02:49:48.310639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
17352024-12-21T03:01:52.017ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 179.247654ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]}},"default_endpoint":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17362024-12-21T03:01:52.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17372024-12-21T03:01:52.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17382024-12-21T03:01:52.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17392024-12-21T03:01:52.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17402024-12-21T03:01:52.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17412024-12-21T03:01:52.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17422024-12-21T03:01:52.053ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17432024-12-21T03:01:52.053ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17442024-12-21T03:01:52.054ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b6c9d7-de39-4b71-bb5c-453b5d40ebef", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
17452024-12-21T03:01:52.054ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17462024-12-21T03:01:52.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17472024-12-21T03:01:52.083ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 245.195595ms iteration = 29 status = {"physical_disks_added":0}
17482024-12-21T03:01:52.105ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
17492024-12-21T03:01:52.105ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17502024-12-21T03:01:52.105ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6233c3b-dd0c-499b-bd55-8dbd5d9b5732", "content-length": "26", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
17512024-12-21T03:01:52.105ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17522024-12-21T03:01:52.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
17532024-12-21T03:01:52.192ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
17542024-12-21T03:01:52.194ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552024-12-21T03:01:52.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17562024-12-21T03:01:52.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17572024-12-21T03:01:52.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17582024-12-21T03:01:52.197ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17592024-12-21T03:01:52.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17602024-12-21T03:01:52.235ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17612024-12-21T03:01:52.235ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 0 version = 2
17622024-12-21T03:01:52.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17632024-12-21T03:01:52.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17642024-12-21T03:01:52.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 399.300865ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17652024-12-21T03:01:52.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-12-21T03:01:52.241ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17672024-12-21T03:01:52.241ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17682024-12-21T03:01:52.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 403.529554ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17692024-12-21T03:01:52.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
17702024-12-21T03:01:52.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17712024-12-21T03:01:52.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17722024-12-21T03:01:52.243ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17732024-12-21T03:01:52.243ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17742024-12-21T03:01:52.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17752024-12-21T03:01:52.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17762024-12-21T03:01:52.245ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 407.095026ms iteration = 25 status = 0
17772024-12-21T03:01:52.245ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17782024-12-21T03:01:52.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17792024-12-21T03:01:52.247ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
17802024-12-21T03:01:52.247ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 409.826208ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17812024-12-21T03:01:52.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17822024-12-21T03:01:52.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17832024-12-21T03:01:52.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17842024-12-21T03:01:52.252ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17852024-12-21T03:01:52.252ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17862024-12-21T03:01:52.252ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 02:49:52.719690 UTC dns_group = internal generation = 1
17872024-12-21T03:01:52.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 414.685414ms iteration = 14 status = {"generation":1}
17882024-12-21T03:01:52.263ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17892024-12-21T03:01:52.263ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3fe69f-c94a-4030-900f-2e49723d7942", "content-length": "1", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
17902024-12-21T03:01:52.266ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17912024-12-21T03:01:52.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17922024-12-21T03:01:52.269ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.946395ms iteration = 25 status = null
17932024-12-21T03:01:52.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-12-21T03:01:52.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17952024-12-21T03:01:52.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17962024-12-21T03:01:52.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17972024-12-21T03:01:52.280ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17982024-12-21T03:01:52.280ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 442.918755ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17992024-12-21T03:01:52.281ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 1 version = 2
18002024-12-21T03:01:52.281ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18012024-12-21T03:01:52.281ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 02:49:54.573469 UTC dns_group = external generation = 2
18022024-12-21T03:01:52.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 442.723643ms iteration = 14 status = {"generation":2}
18032024-12-21T03:01:52.307ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
18042024-12-21T03:01:52.307ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e3058701-4052-4ec1-9f8f-41100715e9a6", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18052024-12-21T03:01:52.307ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18062024-12-21T03:01:52.308ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 470.482347ms iteration = 25 status = {}
18072024-12-21T03:01:52.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "88d58113-f5c2-43fd-8876-19102dd05176", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18082024-12-21T03:01:52.310ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18092024-12-21T03:01:52.312ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18102024-12-21T03:01:52.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 474.17786ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
18112024-12-21T03:01:52.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18122024-12-21T03:01:52.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18132024-12-21T03:01:52.331ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18142024-12-21T03:01:52.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18152024-12-21T03:01:52.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162024-12-21T03:01:52.332ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "495597c6-4e15-43a1-bfee-557bbf95b958", "content-length": "523", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
18172024-12-21T03:01:52.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18182024-12-21T03:01:52.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18192024-12-21T03:01:52.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18202024-12-21T03:01:52.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18212024-12-21T03:01:52.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18222024-12-21T03:01:52.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18232024-12-21T03:01:52.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18242024-12-21T03:01:52.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18252024-12-21T03:01:52.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18262024-12-21T03:01:52.360ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
18272024-12-21T03:01:52.361ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e0769b76-53f1-4eff-981d-8f2fa02584d5", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18282024-12-21T03:01:52.361ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18292024-12-21T03:01:52.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e5738d2d-345c-4577-8b02-1592b15fb9d4", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18302024-12-21T03:01:52.364ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18312024-12-21T03:01:52.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cb9e4b0d-f905-4c12-95b6-564aa9c7f0a1", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18322024-12-21T03:01:52.366ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18332024-12-21T03:01:52.369ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18342024-12-21T03:01:52.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 531.428169ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18352024-12-21T03:01:52.387ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {5172f171-d114-4b2b-890e-c84f93efd72f: {10.151.2.176: {430c7688-3300-43d1-9f47-aa431fc823c5}, 10.151.2.175: {430c7688-3300-43d1-9f47-aa431fc823c5}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18362024-12-21T03:01:52.387ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18372024-12-21T03:01:52.387ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60361547-b952-49ea-ae81-c1599239b596", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
18382024-12-21T03:01:52.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18392024-12-21T03:01:52.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18402024-12-21T03:01:52.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18412024-12-21T03:01:52.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18422024-12-21T03:01:52.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18432024-12-21T03:01:52.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18442024-12-21T03:01:52.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18452024-12-21T03:01:52.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18462024-12-21T03:01:52.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18472024-12-21T03:01:52.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18482024-12-21T03:01:52.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18492024-12-21T03:01:52.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18502024-12-21T03:01:52.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18512024-12-21T03:01:52.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18522024-12-21T03:01:52.407ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
18532024-12-21T03:01:52.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18542024-12-21T03:01:52.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18552024-12-21T03:01:52.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18562024-12-21T03:01:52.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18572024-12-21T03:01:52.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18582024-12-21T03:01:52.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18592024-12-21T03:01:52.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18602024-12-21T03:01:52.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18612024-12-21T03:01:52.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18622024-12-21T03:01:52.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18632024-12-21T03:01:52.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18642024-12-21T03:01:52.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "657d2fb2-0cfe-471d-bbdd-82f1f8b41250", "content-length": "134", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
18652024-12-21T03:01:52.417ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18662024-12-21T03:01:52.417ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
18672024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18682024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18692024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18702024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18712024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18722024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18732024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18742024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18752024-12-21T03:01:52.418ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
18762024-12-21T03:01:52.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18772024-12-21T03:01:52.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18782024-12-21T03:01:52.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18792024-12-21T03:01:52.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18802024-12-21T03:01:52.422ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18812024-12-21T03:01:52.422ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9efc6bae-77d1-4932-a12a-90154e7903fb", "content-length": "2", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
18822024-12-21T03:01:52.422ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18832024-12-21T03:01:52.422ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "173499a3-1c06-4aee-ab96-1d00ffb14f16", "content-length": "52", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
18842024-12-21T03:01:52.422ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
18852024-12-21T03:01:52.422ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18862024-12-21T03:01:52.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18872024-12-21T03:01:52.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18882024-12-21T03:01:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18892024-12-21T03:01:52.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18902024-12-21T03:01:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18912024-12-21T03:01:52.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18922024-12-21T03:01:52.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: bee01f1b-ec92-4122-8c75-e3f93761773c, lookup_type: ById(bee01f1b-ec92-4122-8c75-e3f93761773c) }, key: 13a385fe-88b2-4d69-a957-fa8b739c2ea8, lookup_type: ById(13a385fe-88b2-4d69-a957-fa8b739c2ea8) } result = Ok(())
18932024-12-21T03:01:52.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18942024-12-21T03:01:52.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18952024-12-21T03:01:52.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18962024-12-21T03:01:52.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18972024-12-21T03:01:52.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18982024-12-21T03:01:52.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18992024-12-21T03:01:52.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-12-21T03:01:52.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: bee01f1b-ec92-4122-8c75-e3f93761773c, lookup_type: ById(bee01f1b-ec92-4122-8c75-e3f93761773c) }, key: 13a385fe-88b2-4d69-a957-fa8b739c2ea8, lookup_type: ById(13a385fe-88b2-4d69-a957-fa8b739c2ea8) } result = Ok(())
19012024-12-21T03:01:52.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19022024-12-21T03:01:52.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19032024-12-21T03:01:52.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19042024-12-21T03:01:52.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19052024-12-21T03:01:52.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19062024-12-21T03:01:52.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19072024-12-21T03:01:52.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19082024-12-21T03:01:52.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19092024-12-21T03:01:52.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19102024-12-21T03:01:52.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19112024-12-21T03:01:52.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19122024-12-21T03:01:52.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19132024-12-21T03:01:52.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19142024-12-21T03:01:52.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19152024-12-21T03:01:52.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19162024-12-21T03:01:52.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19172024-12-21T03:01:52.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-12-21T03:01:52.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: bee01f1b-ec92-4122-8c75-e3f93761773c, lookup_type: ById(bee01f1b-ec92-4122-8c75-e3f93761773c) }, key: b573b401-3927-4a27-9a02-2636c1bf9e8f, lookup_type: ByName("default") } result = Ok(())
19192024-12-21T03:01:52.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19202024-12-21T03:01:52.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19212024-12-21T03:01:52.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19222024-12-21T03:01:52.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19232024-12-21T03:01:52.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19242024-12-21T03:01:52.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19252024-12-21T03:01:52.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19262024-12-21T03:01:52.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19272024-12-21T03:01:52.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19282024-12-21T03:01:52.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19292024-12-21T03:01:52.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19302024-12-21T03:01:52.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19312024-12-21T03:01:52.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19322024-12-21T03:01:52.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19332024-12-21T03:01:52.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19342024-12-21T03:01:52.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: bee01f1b-ec92-4122-8c75-e3f93761773c, lookup_type: ById(bee01f1b-ec92-4122-8c75-e3f93761773c) }, key: 430c7688-3300-43d1-9f47-aa431fc823c5, lookup_type: ByName("default") } result = Ok(())
19352024-12-21T03:01:52.572ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19362024-12-21T03:01:52.572ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19372024-12-21T03:01:52.573ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c72be8e7-ea63-452b-ad02-123c96a688e8", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
19382024-12-21T03:01:52.573ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
19392024-12-21T03:01:52.573ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19402024-12-21T03:01:52.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d132643-bac6-4f2d-92f8-da5ae506a44d", "content-length": "682", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
19412024-12-21T03:01:52.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19422024-12-21T03:01:52.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19432024-12-21T03:01:52.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c40e0895-354b-4313-84e1-901ffc5ce97d", "content-length": "810", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
19442024-12-21T03:01:52.574ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5175235) }} sled = sock
19452024-12-21T03:01:52.574ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19462024-12-21T03:01:52.574ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19472024-12-21T03:01:52.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6bd0915e-3dc2-41bf-bf55-7e1133c43cd4", "date": "Sat, 21 Dec 2024 03:01:52 GMT"} })
19482024-12-21T03:01:52.576ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 737.79708ms iteration = 25 status = {}
19492024-12-21T03:01:52.577ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 739.002574ms iteration = 26 status = {}
19502024-12-21T03:01:52.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19512024-12-21T03:01:52.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19522024-12-21T03:01:52.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19532024-12-21T03:01:52.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19542024-12-21T03:01:52.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19552024-12-21T03:01:52.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19562024-12-21T03:01:52.597ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 759.276211ms iteration = 25 status = {}
19572024-12-21T03:01:52.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68d07bc0-44da-470b-939c-4705190b9490 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19582024-12-21T03:01:52.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68d07bc0-44da-470b-939c-4705190b9490 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19592024-12-21T03:01:52.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 68d07bc0-44da-470b-939c-4705190b9490 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19602024-12-21T03:01:53.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b792b10-3be5-4ba6-ab3f-6b267af43a8f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19612024-12-21T03:01:53.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b792b10-3be5-4ba6-ab3f-6b267af43a8f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19622024-12-21T03:01:53.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b792b10-3be5-4ba6-ab3f-6b267af43a8f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19632024-12-21T03:01:54.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1255 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 42738697-8919-484a-aa09-0464625a0260 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
19642024-12-21T03:01:54.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2bb3c62b-be9c-4d27-9d5a-dc6e7392777f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19652024-12-21T03:01:54.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2bb3c62b-be9c-4d27-9d5a-dc6e7392777f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19662024-12-21T03:01:54.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2bb3c62b-be9c-4d27-9d5a-dc6e7392777f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19672024-12-21T03:01:55.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 26e511ca-4b7e-42e8-84ed-876a1d0e834d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19682024-12-21T03:01:55.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 26e511ca-4b7e-42e8-84ed-876a1d0e834d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19692024-12-21T03:01:55.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 26e511ca-4b7e-42e8-84ed-876a1d0e834d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19702024-12-21T03:01:56.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b49268cc-b298-47ea-a787-83472590f02a", "content-length": "131", "date": "Sat, 21 Dec 2024 03:01:56 GMT"} })
19712024-12-21T03:01:56.744ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T03:01:49.083474222Z }, migration_in: None, migration_out: None } vmm_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19722024-12-21T03:01:56.744ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 vmm_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T03:01:49.083474222Z }
19732024-12-21T03:01:56.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc roles = RoleSet { roles: {} } sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 vmm_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19742024-12-21T03:01:56.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc resource = Database result = Ok(()) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 vmm_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19752024-12-21T03:01:56.749ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 74dde502-fff3-4345-96ff-5b5cb7266244 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T03:01:56.742690314Z }
19762024-12-21T03:01:56.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 74dde502-fff3-4345-96ff-5b5cb7266244 roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19772024-12-21T03:01:56.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 74dde502-fff3-4345-96ff-5b5cb7266244 resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19782024-12-21T03:01:56.767ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
19792024-12-21T03:01:56.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.93109135s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
19802024-12-21T03:01:56.779ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:43757
19812024-12-21T03:01:56.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43757 req_id = 4a92925e-c86d-40a0-abb9-30407a81f1c6 roles = RoleSet { roles: {} } uri = /metrics/producers
19822024-12-21T03:01:56.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43757 req_id = 4a92925e-c86d-40a0-abb9-30407a81f1c6 resource = Database result = Ok(()) uri = /metrics/producers
19832024-12-21T03:01:56.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49768 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 74dde502-fff3-4345-96ff-5b5cb7266244 response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19842024-12-21T03:01:56.793ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e039968-7c80-4144-b7b0-1a58518cd663 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T03:01:56.792978221Z }
19852024-12-21T03:01:56.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e039968-7c80-4144-b7b0-1a58518cd663 roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19862024-12-21T03:01:56.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e039968-7c80-4144-b7b0-1a58518cd663 resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19872024-12-21T03:01:56.818ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc
19882024-12-21T03:01:56.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38813 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43757 req_id = 4a92925e-c86d-40a0-abb9-30407a81f1c6 response_code = 201 uri = /metrics/producers
19892024-12-21T03:01:56.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40635 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1e039968-7c80-4144-b7b0-1a58518cd663 response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
19902024-12-21T03:01:56.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ef4285c-7ebc-4a05-8acc-fa39e4da0d27 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19912024-12-21T03:01:56.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ef4285c-7ebc-4a05-8acc-fa39e4da0d27 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19922024-12-21T03:01:56.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ef4285c-7ebc-4a05-8acc-fa39e4da0d27 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19932024-12-21T03:01:57.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3814f66-cdb0-4b95-9f6d-cca3cf1f8ec7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19942024-12-21T03:01:57.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3814f66-cdb0-4b95-9f6d-cca3cf1f8ec7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19952024-12-21T03:01:57.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a3814f66-cdb0-4b95-9f6d-cca3cf1f8ec7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19962024-12-21T03:01:58.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d11beaf5-3428-4d73-b5ea-59f0b2eb2f42 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19972024-12-21T03:01:58.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d11beaf5-3428-4d73-b5ea-59f0b2eb2f42 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19982024-12-21T03:01:58.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d11beaf5-3428-4d73-b5ea-59f0b2eb2f42 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
19992024-12-21T03:02:00.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 75f32bd4-eb9e-4636-879b-fe79effd6566 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20002024-12-21T03:02:00.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 75f32bd4-eb9e-4636-879b-fe79effd6566 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20012024-12-21T03:02:00.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 75f32bd4-eb9e-4636-879b-fe79effd6566 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20022024-12-21T03:02:01.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb38bdef-b4c9-4750-8cbc-d008cc76455e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20032024-12-21T03:02:01.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb38bdef-b4c9-4750-8cbc-d008cc76455e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20042024-12-21T03:02:01.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb38bdef-b4c9-4750-8cbc-d008cc76455e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20052024-12-21T03:02:01.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
20062024-12-21T03:02:01.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20072024-12-21T03:02:01.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
20082024-12-21T03:02:01.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20092024-12-21T03:02:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20102024-12-21T03:02:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20112024-12-21T03:02:01.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122024-12-21T03:02:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20132024-12-21T03:02:01.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20142024-12-21T03:02:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20152024-12-21T03:02:01.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20162024-12-21T03:02:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20172024-12-21T03:02:01.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20182024-12-21T03:02:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
20192024-12-21T03:02:01.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20202024-12-21T03:02:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20212024-12-21T03:02:01.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
20222024-12-21T03:02:01.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.081497ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
20232024-12-21T03:02:01.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20242024-12-21T03:02:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20252024-12-21T03:02:01.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.385021ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20262024-12-21T03:02:02.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f5f27c55-7542-4409-b590-90354244e2c0 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20272024-12-21T03:02:02.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f5f27c55-7542-4409-b590-90354244e2c0 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20282024-12-21T03:02:02.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f5f27c55-7542-4409-b590-90354244e2c0 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20292024-12-21T03:02:03.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c700158-45de-4f29-a4a2-3f5e0caf280b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20302024-12-21T03:02:03.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c700158-45de-4f29-a4a2-3f5e0caf280b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20312024-12-21T03:02:03.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2c700158-45de-4f29-a4a2-3f5e0caf280b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20322024-12-21T03:02:04.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = f6418c45-6048-4ed3-9532-79379ec4059e response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
20332024-12-21T03:02:04.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d93aebea-4261-40db-904c-8ca97f3d36cb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20342024-12-21T03:02:04.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d93aebea-4261-40db-904c-8ca97f3d36cb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20352024-12-21T03:02:04.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d93aebea-4261-40db-904c-8ca97f3d36cb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20362024-12-21T03:02:05.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1db8fe1c-b45d-424e-b57d-c662de3b5fa1 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20372024-12-21T03:02:05.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1db8fe1c-b45d-424e-b57d-c662de3b5fa1 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20382024-12-21T03:02:05.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1db8fe1c-b45d-424e-b57d-c662de3b5fa1 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20392024-12-21T03:02:06.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = af4173cd-5eb0-4a4e-b9dc-e6bfedea4237 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20402024-12-21T03:02:06.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = af4173cd-5eb0-4a4e-b9dc-e6bfedea4237 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20412024-12-21T03:02:06.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = af4173cd-5eb0-4a4e-b9dc-e6bfedea4237 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20422024-12-21T03:02:06.729ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91e09c8d-d653-4471-a056-ab5c0bd257ce uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T03:02:06.728866351Z }
20432024-12-21T03:02:06.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91e09c8d-d653-4471-a056-ab5c0bd257ce roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20442024-12-21T03:02:06.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91e09c8d-d653-4471-a056-ab5c0bd257ce resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20452024-12-21T03:02:06.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7386 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91e09c8d-d653-4471-a056-ab5c0bd257ce response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20462024-12-21T03:02:06.737ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 181e8f5d-f21d-41b7-80c2-a27864496d88 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-21T03:02:06.737417191Z }
20472024-12-21T03:02:06.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 181e8f5d-f21d-41b7-80c2-a27864496d88 roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20482024-12-21T03:02:06.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 181e8f5d-f21d-41b7-80c2-a27864496d88 resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20492024-12-21T03:02:06.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67736 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 181e8f5d-f21d-41b7-80c2-a27864496d88 response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20502024-12-21T03:02:07.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 293c9725-f1a8-4063-bd2a-c784bcf1657a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
20512024-12-21T03:02:07.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 293c9725-f1a8-4063-bd2a-c784bcf1657a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
20522024-12-21T03:02:07.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 293c9725-f1a8-4063-bd2a-c784bcf1657a response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
20532024-12-21T03:02:07.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 32e80807-86a4-4436-9288-dc88d91e1af1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20542024-12-21T03:02:07.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 32e80807-86a4-4436-9288-dc88d91e1af1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20552024-12-21T03:02:07.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 32e80807-86a4-4436-9288-dc88d91e1af1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20562024-12-21T03:02:07.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ebe377-cd82-4557-ae99-27449589c3f7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20572024-12-21T03:02:07.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ebe377-cd82-4557-ae99-27449589c3f7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20582024-12-21T03:02:07.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 51ebe377-cd82-4557-ae99-27449589c3f7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20592024-12-21T03:02:08.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4cf630f2-5047-4d17-b5d5-8d90be5a281a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20602024-12-21T03:02:08.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4cf630f2-5047-4d17-b5d5-8d90be5a281a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20612024-12-21T03:02:08.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4cf630f2-5047-4d17-b5d5-8d90be5a281a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20622024-12-21T03:02:09.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6b9487d4-0239-4020-b2b9-b1f4d36b83ae roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20632024-12-21T03:02:09.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6b9487d4-0239-4020-b2b9-b1f4d36b83ae resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20642024-12-21T03:02:09.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6b9487d4-0239-4020-b2b9-b1f4d36b83ae response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20652024-12-21T03:02:09.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ed2b2731-1d32-44d9-9845-6967b1cb83ff roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20662024-12-21T03:02:09.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ed2b2731-1d32-44d9-9845-6967b1cb83ff resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20672024-12-21T03:02:09.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ed2b2731-1d32-44d9-9845-6967b1cb83ff response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
20682024-12-21T03:02:09.248ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-21T03:02:09.248327826Z }
20692024-12-21T03:02:09.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20702024-12-21T03:02:09.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20712024-12-21T03:02:09.263ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_needs_update = true
20722024-12-21T03:02:09.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20732024-12-21T03:02:09.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20742024-12-21T03:02:09.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20752024-12-21T03:02:09.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20762024-12-21T03:02:09.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20772024-12-21T03:02:09.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20782024-12-21T03:02:09.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20792024-12-21T03:02:09.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20802024-12-21T03:02:09.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20812024-12-21T03:02:09.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20822024-12-21T03:02:09.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20832024-12-21T03:02:09.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20842024-12-21T03:02:09.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20852024-12-21T03:02:09.280ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc, lookup_type: ById(f2add1f4-4e07-40dd-8c24-b64c4cfa91fc) } result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20862024-12-21T03:02:09.280ZINFOnexus (dropshot_internal): starting update saga for f2add1f4-4e07-40dd-8c24-b64c4cfa91fc actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-21T03:02:09.248327826Z }
20872024-12-21T03:02:09.282ZDEBGnexus (dropshot_internal): preparing instance-update saga for f2add1f4-4e07-40dd-8c24-b64c4cfa91fc... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20882024-12-21T03:02:09.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34095 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3d5a7e84-66c0-4fa5-9e85-6247ad52dcee response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20892024-12-21T03:02:09.282ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update
20902024-12-21T03:02:09.282ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f2add1f4-4e07-40dd-8c24-b64c4cfa91fc","lookup_type":{"ById":"f2add1f4-4e07-40dd-8c24-b64c4cfa91fc"},"parent":{"key":"7296de35-aa8c-45ba-9ca3-77ba0f00bdcd","lookup_type":{"ById":"7296de35-aa8c-45ba-9ca3-77ba0f00bdcd"},"parent":{"key":"871537f7-f2d9-43ea-807b-39a8eba23cc8","lookup_type":{"ById":"871537f7-f2d9-43ea-807b-39a8eba23cc8"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
20912024-12-21T03:02:09.282ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update
20922024-12-21T03:02:09.282ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 250c4d01-d90e-4c42-bd31-905e1390f99d uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-21T03:02:09.248327826Z }
20932024-12-21T03:02:09.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 250c4d01-d90e-4c42-bd31-905e1390f99d roles = RoleSet { roles: {} } uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20942024-12-21T03:02:09.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 250c4d01-d90e-4c42-bd31-905e1390f99d resource = Database result = Ok(()) uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20952024-12-21T03:02:09.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3734 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 250c4d01-d90e-4c42-bd31-905e1390f99d response_code = 204 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
20962024-12-21T03:02:09.314ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update
20972024-12-21T03:02:09.314ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
20982024-12-21T03:02:09.314ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
20992024-12-21T03:02:09.314ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21002024-12-21T03:02:09.321ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21012024-12-21T03:02:09.321ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21022024-12-21T03:02:09.323ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21032024-12-21T03:02:09.323ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21042024-12-21T03:02:09.326ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21052024-12-21T03:02:09.326ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4")) node_id = 0 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21062024-12-21T03:02:09.330ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21072024-12-21T03:02:09.330ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21082024-12-21T03:02:09.333ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update
21092024-12-21T03:02:09.333ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21102024-12-21T03:02:09.333ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21112024-12-21T03:02:09.335ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21122024-12-21T03:02:09.335ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21132024-12-21T03:02:09.336ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21142024-12-21T03:02:09.337ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21152024-12-21T03:02:09.338ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21162024-12-21T03:02:09.338ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21172024-12-21T03:02:09.339ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21182024-12-21T03:02:09.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21192024-12-21T03:02:09.341ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21202024-12-21T03:02:09.341ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21212024-12-21T03:02:09.342ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21222024-12-21T03:02:09.345ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc, lookup_type: ById(f2add1f4-4e07-40dd-8c24-b64c4cfa91fc) } result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21232024-12-21T03:02:09.345ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance updater_id = 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4
21242024-12-21T03:02:09.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21252024-12-21T03:02:09.346ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21262024-12-21T03:02:09.354ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance updater_id = 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4
21272024-12-21T03:02:09.354ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21282024-12-21T03:02:09.354ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance
21292024-12-21T03:02:09.358ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc locked_gen = Generation(Generation(2)) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = LockInstance updater_id = 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4
21302024-12-21T03:02:09.360ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21312024-12-21T03:02:09.360ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4")}) node_id = 1 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21322024-12-21T03:02:09.364ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21332024-12-21T03:02:09.364ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
21342024-12-21T03:02:09.367ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21352024-12-21T03:02:09.367ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21362024-12-21T03:02:09.373ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21372024-12-21T03:02:09.373ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21382024-12-21T03:02:09.374ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21392024-12-21T03:02:09.375ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21402024-12-21T03:02:09.376ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21412024-12-21T03:02:09.379ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc, lookup_type: ById(f2add1f4-4e07-40dd-8c24-b64c4cfa91fc) } result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21422024-12-21T03:02:09.379ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21432024-12-21T03:02:09.379ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21442024-12-21T03:02:09.385ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2, time_created: 2024-12-21T03:01:48.617117Z, time_deleted: None, instance_id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc, sled_id: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-21T03:02:09.248327Z, gen: Generation(Generation(9)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T03:01:46.526926Z, gen: Generation(Generation(3)), propolis_id: Some(b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T03:02:09.385041913Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
21452024-12-21T03:02:09.389ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21462024-12-21T03:02:09.389ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f2add1f4-4e07-40dd-8c24-b64c4cfa91fc","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f2add1f4-4e07-40dd-8c24-b64c4cfa91fc","lookup_type":{"ById":"f2add1f4-4e07-40dd-8c24-b64c4cfa91fc"},"parent":{"key":"7296de35-aa8c-45ba-9ca3-77ba0f00bdcd","lookup_type":{"ById":"7296de35-aa8c-45ba-9ca3-77ba0f00bdcd"},"parent":{"key":"871537f7-f2d9-43ea-807b-39a8eba23cc8","lookup_type":{"ById":"871537f7-f2d9-43ea-807b-39a8eba23cc8"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"7296de35-aa8c-45ba-9ca3-77ba0f00bdcd","ram_diff":1073741824},"destroy_active_vmm":"b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-21T03:02:09.385041913Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21472024-12-21T03:02:09.390ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21482024-12-21T03:02:09.428ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21492024-12-21T03:02:09.428ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21502024-12-21T03:02:09.428ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21512024-12-21T03:02:09.428ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21522024-12-21T03:02:09.434ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21532024-12-21T03:02:09.434ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21542024-12-21T03:02:09.440ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21552024-12-21T03:02:09.440ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21562024-12-21T03:02:09.446ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21572024-12-21T03:02:09.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("60ace72c-7092-4419-ad19-34f5d6946202")) node_id = 0 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21582024-12-21T03:02:09.453ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21592024-12-21T03:02:09.453ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21602024-12-21T03:02:09.457ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc parent_lock = UpdaterLock { updater_id: 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4, locked_gen: Generation(Generation(2)) } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21612024-12-21T03:02:09.457ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = BecomeUpdater
21622024-12-21T03:02:09.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = BecomeUpdater
21632024-12-21T03:02:09.467ZDEBGnexus (SagaExecutor): inherited lock from 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4 to 60ace72c-7092-4419-ad19-34f5d6946202 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = BecomeUpdater updater_id = 60ace72c-7092-4419-ad19-34f5d6946202
21642024-12-21T03:02:09.467ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21652024-12-21T03:02:09.467ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21662024-12-21T03:02:09.467ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("60ace72c-7092-4419-ad19-34f5d6946202")}) node_id = 1 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21672024-12-21T03:02:09.469ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21682024-12-21T03:02:09.469ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21692024-12-21T03:02:09.472ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21702024-12-21T03:02:09.472ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21712024-12-21T03:02:09.476ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
21722024-12-21T03:02:09.476ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
21732024-12-21T03:02:09.479ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
21742024-12-21T03:02:09.481ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc
21752024-12-21T03:02:09.486ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21762024-12-21T03:02:09.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21772024-12-21T03:02:09.488ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21782024-12-21T03:02:09.488ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21792024-12-21T03:02:09.490ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
21802024-12-21T03:02:09.490ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21812024-12-21T03:02:09.490ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UpdateNetworkConfig
21822024-12-21T03:02:09.492ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
21832024-12-21T03:02:09.492ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
21842024-12-21T03:02:09.492ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
21852024-12-21T03:02:09.493ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
21862024-12-21T03:02:09.495ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
21872024-12-21T03:02:09.495ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
21882024-12-21T03:02:09.495ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
21892024-12-21T03:02:09.499ZDEBGnexus: notifying dendrite of updates instance_id = Some(f2add1f4-4e07-40dd-8c24-b64c4cfa91fc (instance)) switch = switch0
21902024-12-21T03:02:09.499ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1775, tv_nsec: 557329271 } })
21912024-12-21T03:02:09.500ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
21922024-12-21T03:02:09.530ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
21932024-12-21T03:02:09.530ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21942024-12-21T03:02:09.530ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b512a445-c903-4048-96bf-09e51faa3c12", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
21952024-12-21T03:02:09.530ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21962024-12-21T03:02:09.531ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21972024-12-21T03:02:09.560ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
21982024-12-21T03:02:09.560ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb51a2dd-eca2-4736-9425-89a0a7880b8a", "content-length": "4", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
21992024-12-21T03:02:09.561ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22002024-12-21T03:02:09.561ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22012024-12-21T03:02:09.564ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22022024-12-21T03:02:09.564ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22032024-12-21T03:02:09.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
22042024-12-21T03:02:09.567ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
22052024-12-21T03:02:09.655ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-21T03:02:09.575955Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, time_modified: Some(2024-12-21T03:02:09.575955Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, time_modified: Some(2024-12-21T03:02:09.575955Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22062024-12-21T03:02:09.655ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22072024-12-21T03:02:09.655ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22082024-12-21T03:02:09.663ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22092024-12-21T03:02:09.663ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22102024-12-21T03:02:09.672ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22112024-12-21T03:02:09.674ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UnassignOximeterProducer
22122024-12-21T03:02:09.674ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UnassignOximeterProducer
22132024-12-21T03:02:09.682ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f producer_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22142024-12-21T03:02:09.682ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UnassignOximeterProducer
22152024-12-21T03:02:09.683ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = UnassignOximeterProducer
22162024-12-21T03:02:09.718ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22172024-12-21T03:02:09.720ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f2add1f4-4e07-40dd-8c24-b64c4cfa91fc
22182024-12-21T03:02:09.736ZDEBGnexus (SagaExecutor): client response oximeter-collector = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f2add1f4-4e07-40dd-8c24-b64c4cfa91fc", status: 204, headers: {"x-request-id": "3213e311-6310-4a8c-927e-e376969ff330", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} }) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22192024-12-21T03:02:09.736ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f producer_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22202024-12-21T03:02:09.738ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22212024-12-21T03:02:09.738ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22222024-12-21T03:02:09.744ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22232024-12-21T03:02:09.744ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22242024-12-21T03:02:09.750ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc lock = UpdaterLock { updater_id: 60ace72c-7092-4419-ad19-34f5d6946202, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T03:02:09.385041913Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22252024-12-21T03:02:09.750ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = CommitInstanceUpdates
22262024-12-21T03:02:09.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = CommitInstanceUpdates
22272024-12-21T03:02:09.789ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T03:02:09.385041913Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22282024-12-21T03:02:09.789ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22292024-12-21T03:02:09.789ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22302024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
22312024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
22322024-12-21T03:02:09.789ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22332024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22342024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22352024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22362024-12-21T03:02:09.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22372024-12-21T03:02:09.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382024-12-21T03:02:09.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22392024-12-21T03:02:09.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22402024-12-21T03:02:09.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22412024-12-21T03:02:09.795ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22422024-12-21T03:02:09.795ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22432024-12-21T03:02:09.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22442024-12-21T03:02:09.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22452024-12-21T03:02:09.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22462024-12-21T03:02:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22472024-12-21T03:02:09.798ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22482024-12-21T03:02:09.798ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f2add1f4-4e07-40dd-8c24-b64c4cfa91fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2")}) node_id = 7 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22492024-12-21T03:02:09.802ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22502024-12-21T03:02:09.802ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22512024-12-21T03:02:09.807ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22522024-12-21T03:02:09.807ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22532024-12-21T03:02:09.811ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22542024-12-21T03:02:09.811ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22552024-12-21T03:02:09.815ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22562024-12-21T03:02:09.815ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ReleaseSledResources
22572024-12-21T03:02:09.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ReleaseSledResources
22582024-12-21T03:02:09.823ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22592024-12-21T03:02:09.823ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22602024-12-21T03:02:09.826ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22612024-12-21T03:02:09.826ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22622024-12-21T03:02:09.830ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22632024-12-21T03:02:09.830ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = MarkVmmDeleted
22642024-12-21T03:02:09.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = MarkVmmDeleted
22652024-12-21T03:02:09.841ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22662024-12-21T03:02:09.841ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22672024-12-21T03:02:09.844ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22682024-12-21T03:02:09.844ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22692024-12-21T03:02:09.848ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22702024-12-21T03:02:09.848ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22712024-12-21T03:02:09.851ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22722024-12-21T03:02:09.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22732024-12-21T03:02:09.854ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22742024-12-21T03:02:09.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22752024-12-21T03:02:09.856ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22762024-12-21T03:02:09.856ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22772024-12-21T03:02:09.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22782024-12-21T03:02:09.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22792024-12-21T03:02:09.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22802024-12-21T03:02:09.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22812024-12-21T03:02:09.885ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22822024-12-21T03:02:09.885ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22832024-12-21T03:02:09.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d721f36-99ca-4196-891a-168625306fe9", "content-length": "372", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
22842024-12-21T03:02:09.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22852024-12-21T03:02:09.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22862024-12-21T03:02:09.886ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22872024-12-21T03:02:09.890ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 871537f7-f2d9-43ea-807b-39a8eba23cc8, lookup_type: ById(871537f7-f2d9-43ea-807b-39a8eba23cc8) }, key: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd, lookup_type: ById(7296de35-aa8c-45ba-9ca3-77ba0f00bdcd) }, key: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc, lookup_type: ById(f2add1f4-4e07-40dd-8c24-b64c4cfa91fc) } result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22882024-12-21T03:02:09.890ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22892024-12-21T03:02:09.890ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_node = ChainSuccessorSaga
22902024-12-21T03:02:09.892ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc karmic_state = WillReincarnate needs_reincarnation = false saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update
22912024-12-21T03:02:09.892ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22922024-12-21T03:02:09.893ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22932024-12-21T03:02:09.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22942024-12-21T03:02:09.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22952024-12-21T03:02:09.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-12-21T03:02:09.896ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
22972024-12-21T03:02:09.896ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
22982024-12-21T03:02:09.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22992024-12-21T03:02:09.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23002024-12-21T03:02:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23012024-12-21T03:02:09.899ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23022024-12-21T03:02:09.899ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
23032024-12-21T03:02:09.902ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23042024-12-21T03:02:09.902ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c
23052024-12-21T03:02:09.909ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23062024-12-21T03:02:09.909ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c saga_name = instance-update saga_result = SagaResult { saga_id: 4110ed7f-19ab-4088-9ec0-6c6b022f493c, saga_log: SagaLog { saga_id: 4110ed7f-19ab-4088-9ec0-6c6b022f493c, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("60ace72c-7092-4419-ad19-34f5d6946202")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("60ace72c-7092-4419-ad19-34f5d6946202")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f2add1f4-4e07-40dd-8c24-b64c4cfa91fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f2add1f4-4e07-40dd-8c24-b64c4cfa91fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("60ace72c-7092-4419-ad19-34f5d6946202"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("60ace72c-7092-4419-ad19-34f5d6946202")}} }) }
23072024-12-21T03:02:09.909ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 4110ed7f-19ab-4088-9ec0-6c6b022f493c instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update
23082024-12-21T03:02:09.909ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23092024-12-21T03:02:09.909ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
23102024-12-21T03:02:09.913ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23112024-12-21T03:02:09.913ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
23122024-12-21T03:02:09.917ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23132024-12-21T03:02:09.917ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
23142024-12-21T03:02:09.922ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23152024-12-21T03:02:09.922ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32
23162024-12-21T03:02:09.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23172024-12-21T03:02:09.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23182024-12-21T03:02:09.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23192024-12-21T03:02:09.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23202024-12-21T03:02:09.940ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23212024-12-21T03:02:09.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23222024-12-21T03:02:09.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "385c9fe7-9585-45a4-8d5e-ac63f8f40054", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
23232024-12-21T03:02:09.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23242024-12-21T03:02:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23252024-12-21T03:02:09.964ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update sec_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
23262024-12-21T03:02:09.964ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 45de9c1b-9595-44c1-8db9-a7a30e9dce32 saga_name = start-instance-update saga_result = SagaResult { saga_id: 45de9c1b-9595-44c1-8db9-a7a30e9dce32, saga_log: SagaLog { saga_id: 45de9c1b-9595-44c1-8db9-a7a30e9dce32, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("966eb6e9-3d83-4bcf-9bdd-8ad19ed207c4")}} }) }
23272024-12-21T03:02:09.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23282024-12-21T03:02:09.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "beb6baed-af14-4d8c-97b9-70dd20a175b2", "content-length": "691", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
23292024-12-21T03:02:09.971ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23302024-12-21T03:02:09.971ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23312024-12-21T03:02:09.971ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23322024-12-21T03:02:09.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23332024-12-21T03:02:09.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 183.598125ms iteration = 26 status = {}
23342024-12-21T03:02:09.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23352024-12-21T03:02:09.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23362024-12-21T03:02:09.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23372024-12-21T03:02:09.978ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23382024-12-21T03:02:09.978ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23392024-12-21T03:02:09.978ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2934d705-82e1-4431-9183-63ec04a08012", "date": "Sat, 21 Dec 2024 03:02:09 GMT"} })
23402024-12-21T03:02:09.980ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 190.741658ms iteration = 27 status = {}
23412024-12-21T03:02:10.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6172f27c-6ba1-40f2-ad59-cdace23f3a5a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
23422024-12-21T03:02:10.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6172f27c-6ba1-40f2-ad59-cdace23f3a5a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
23432024-12-21T03:02:10.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 6172f27c-6ba1-40f2-ad59-cdace23f3a5a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
23442024-12-21T03:02:10.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 699a4bc0-a077-443b-bb61-d4fa48100af6 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23452024-12-21T03:02:10.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 699a4bc0-a077-443b-bb61-d4fa48100af6 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23462024-12-21T03:02:10.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 699a4bc0-a077-443b-bb61-d4fa48100af6 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23472024-12-21T03:02:11.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 327dc744-189c-460a-aa1d-3befdafd604f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
23482024-12-21T03:02:11.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 327dc744-189c-460a-aa1d-3befdafd604f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
23492024-12-21T03:02:11.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 327dc744-189c-460a-aa1d-3befdafd604f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
23502024-12-21T03:02:11.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06befbc9-cddd-4090-ae48-d8dcb1832127 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23512024-12-21T03:02:11.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06befbc9-cddd-4090-ae48-d8dcb1832127 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23522024-12-21T03:02:11.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06befbc9-cddd-4090-ae48-d8dcb1832127 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23532024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
23542024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23552024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
23562024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23572024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23582024-12-21T03:02:11.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23592024-12-21T03:02:11.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-12-21T03:02:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23612024-12-21T03:02:11.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23622024-12-21T03:02:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23632024-12-21T03:02:11.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23642024-12-21T03:02:11.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652024-12-21T03:02:11.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662024-12-21T03:02:11.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
23672024-12-21T03:02:11.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23682024-12-21T03:02:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23692024-12-21T03:02:11.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
23702024-12-21T03:02:11.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.327995ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
23712024-12-21T03:02:11.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23722024-12-21T03:02:11.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23732024-12-21T03:02:11.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.377762ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23742024-12-21T03:02:12.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85ef7270-e6b4-4e53-a0c7-1e8efd18a3ba roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23752024-12-21T03:02:12.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85ef7270-e6b4-4e53-a0c7-1e8efd18a3ba resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23762024-12-21T03:02:12.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85ef7270-e6b4-4e53-a0c7-1e8efd18a3ba response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23772024-12-21T03:02:13.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4b557cd4-3596-4dc3-86ef-c39638302104 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23782024-12-21T03:02:13.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4b557cd4-3596-4dc3-86ef-c39638302104 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23792024-12-21T03:02:13.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4b557cd4-3596-4dc3-86ef-c39638302104 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23802024-12-21T03:02:14.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = b50e64b3-6fa0-4b33-8846-c1948f2c2d5b response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
23812024-12-21T03:02:14.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06c3d7f2-195e-46f6-aa69-dd6e7937d15b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23822024-12-21T03:02:14.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06c3d7f2-195e-46f6-aa69-dd6e7937d15b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23832024-12-21T03:02:14.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06c3d7f2-195e-46f6-aa69-dd6e7937d15b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23842024-12-21T03:02:15.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cc54019-28ca-45ae-b94a-da8035066245 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23852024-12-21T03:02:15.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cc54019-28ca-45ae-b94a-da8035066245 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23862024-12-21T03:02:15.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5cc54019-28ca-45ae-b94a-da8035066245 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23872024-12-21T03:02:16.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d8ca472e-2004-4e4d-b995-7fff317aecc5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23882024-12-21T03:02:16.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d8ca472e-2004-4e4d-b995-7fff317aecc5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23892024-12-21T03:02:16.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d8ca472e-2004-4e4d-b995-7fff317aecc5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23902024-12-21T03:02:17.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 52a7c282-d6f9-4c94-940d-373b3645a58f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23912024-12-21T03:02:17.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 52a7c282-d6f9-4c94-940d-373b3645a58f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23922024-12-21T03:02:17.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 52a7c282-d6f9-4c94-940d-373b3645a58f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23932024-12-21T03:02:18.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 27e186f9-8022-45f3-85f3-8ec6ae5cf187 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23942024-12-21T03:02:18.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 27e186f9-8022-45f3-85f3-8ec6ae5cf187 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23952024-12-21T03:02:18.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 27e186f9-8022-45f3-85f3-8ec6ae5cf187 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23962024-12-21T03:02:19.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ce927dbd-1cde-4277-9646-15e9529c80aa roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23972024-12-21T03:02:19.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ce927dbd-1cde-4277-9646-15e9529c80aa resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23982024-12-21T03:02:19.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ce927dbd-1cde-4277-9646-15e9529c80aa response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23992024-12-21T03:02:20.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 34bd6766-4255-4b23-88e6-edc2bce857f3 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24002024-12-21T03:02:20.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 34bd6766-4255-4b23-88e6-edc2bce857f3 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24012024-12-21T03:02:20.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 34bd6766-4255-4b23-88e6-edc2bce857f3 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24022024-12-21T03:02:21.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f3e4a305-e037-4837-b5ad-d3788e25d091 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24032024-12-21T03:02:21.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f3e4a305-e037-4837-b5ad-d3788e25d091 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24042024-12-21T03:02:21.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f3e4a305-e037-4837-b5ad-d3788e25d091 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24052024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
24062024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
24072024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24082024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24092024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
24102024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24112024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
24122024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24132024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24142024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
24152024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24162024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
24172024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
24182024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24192024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24202024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
24212024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24222024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
24232024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24242024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
24252024-12-21T03:02:21.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24262024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24272024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
24282024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24292024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
24302024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24312024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
24322024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24332024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
24342024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24352024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
24362024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24372024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
24382024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24392024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
24402024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24412024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
24422024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24432024-12-21T03:02:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24442024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24452024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24462024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24472024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24482024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24492024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24502024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24512024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24522024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24532024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24542024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24552024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24562024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24572024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24582024-12-21T03:02:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24592024-12-21T03:02:21.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602024-12-21T03:02:21.842ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.849985ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24612024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622024-12-21T03:02:21.843ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24632024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24642024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24652024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24662024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24672024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24682024-12-21T03:02:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24692024-12-21T03:02:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24702024-12-21T03:02:21.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24712024-12-21T03:02:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24722024-12-21T03:02:21.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1787, tv_nsec: 905987860 } })
24732024-12-21T03:02:21.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
24742024-12-21T03:02:21.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752024-12-21T03:02:21.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24762024-12-21T03:02:21.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24772024-12-21T03:02:21.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1787, tv_nsec: 909883785 } })
24782024-12-21T03:02:21.852ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
24792024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24802024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24812024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24822024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24832024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24842024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24852024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24862024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24872024-12-21T03:02:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24882024-12-21T03:02:21.857ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24892024-12-21T03:02:21.857ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24902024-12-21T03:02:21.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24912024-12-21T03:02:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24922024-12-21T03:02:21.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24932024-12-21T03:02:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24942024-12-21T03:02:21.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24952024-12-21T03:02:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24962024-12-21T03:02:21.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24972024-12-21T03:02:21.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24982024-12-21T03:02:21.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24992024-12-21T03:02:21.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25002024-12-21T03:02:21.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012024-12-21T03:02:21.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25022024-12-21T03:02:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25032024-12-21T03:02:21.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25042024-12-21T03:02:21.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25052024-12-21T03:02:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25062024-12-21T03:02:21.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072024-12-21T03:02:21.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25082024-12-21T03:02:21.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25092024-12-21T03:02:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25102024-12-21T03:02:21.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25112024-12-21T03:02:21.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25122024-12-21T03:02:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25132024-12-21T03:02:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
25142024-12-21T03:02:21.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25152024-12-21T03:02:21.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25162024-12-21T03:02:21.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25172024-12-21T03:02:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25182024-12-21T03:02:21.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.697824ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
25192024-12-21T03:02:21.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.337913ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
25202024-12-21T03:02:21.911ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25212024-12-21T03:02:21.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25222024-12-21T03:02:21.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-12-21T03:02:21.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242024-12-21T03:02:21.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25252024-12-21T03:02:21.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.009124ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
25262024-12-21T03:02:21.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25272024-12-21T03:02:21.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25282024-12-21T03:02:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25292024-12-21T03:02:21.920ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25302024-12-21T03:02:21.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25312024-12-21T03:02:21.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.388662ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25322024-12-21T03:02:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25332024-12-21T03:02:21.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25342024-12-21T03:02:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25352024-12-21T03:02:21.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25362024-12-21T03:02:21.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
25372024-12-21T03:02:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.015943ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
25382024-12-21T03:02:21.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25392024-12-21T03:02:21.924ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1787, tv_nsec: 981394311 } })
25402024-12-21T03:02:21.924ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
25412024-12-21T03:02:21.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25422024-12-21T03:02:21.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25432024-12-21T03:02:21.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-12-21T03:02:21.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
25452024-12-21T03:02:21.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25462024-12-21T03:02:21.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25472024-12-21T03:02:21.934ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.167803ms iteration = 26 status = 0
25482024-12-21T03:02:21.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.911234ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25492024-12-21T03:02:21.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25502024-12-21T03:02:21.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25512024-12-21T03:02:21.942ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25522024-12-21T03:02:21.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
25532024-12-21T03:02:21.942ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25542024-12-21T03:02:21.942ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c448584c-f24e-453f-a366-9122fe9f7f60", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:21 GMT"} })
25552024-12-21T03:02:21.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25562024-12-21T03:02:21.944ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25572024-12-21T03:02:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25582024-12-21T03:02:21.945ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25592024-12-21T03:02:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25602024-12-21T03:02:21.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
25612024-12-21T03:02:21.946ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25622024-12-21T03:02:21.947ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d310a8-e1e3-4548-8d11-95fe6c5d2b2a", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:21 GMT"} })
25632024-12-21T03:02:21.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25642024-12-21T03:02:21.947ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
25652024-12-21T03:02:21.947ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 108.805572ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
25662024-12-21T03:02:21.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25672024-12-21T03:02:21.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.976965ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25682024-12-21T03:02:21.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.612546ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25692024-12-21T03:02:21.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.026163ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25702024-12-21T03:02:21.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25712024-12-21T03:02:21.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25722024-12-21T03:02:22.038ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.28056ms iteration = 30 status = {"physical_disks_added":0}
25732024-12-21T03:02:22.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25742024-12-21T03:02:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25752024-12-21T03:02:22.141ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25762024-12-21T03:02:22.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25772024-12-21T03:02:22.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddfda31e-657b-4e30-a17a-2ba9a84e1a2f", "content-length": "372", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
25782024-12-21T03:02:22.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25792024-12-21T03:02:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25802024-12-21T03:02:22.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812024-12-21T03:02:22.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25822024-12-21T03:02:22.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25832024-12-21T03:02:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25842024-12-21T03:02:22.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25852024-12-21T03:02:22.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25862024-12-21T03:02:22.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25872024-12-21T03:02:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25882024-12-21T03:02:22.157ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25892024-12-21T03:02:22.157ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25902024-12-21T03:02:22.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2baadfc1-8586-4bae-906f-539bdaa46f83", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
25912024-12-21T03:02:22.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25922024-12-21T03:02:22.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25932024-12-21T03:02:22.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25942024-12-21T03:02:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25952024-12-21T03:02:22.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25962024-12-21T03:02:22.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25972024-12-21T03:02:22.165ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25982024-12-21T03:02:22.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25992024-12-21T03:02:22.166ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ef6f7b53-a1aa-4736-b654-f30debc55646", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26002024-12-21T03:02:22.167ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.350508ms iteration = 28 status = {}
26012024-12-21T03:02:22.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
26022024-12-21T03:02:22.220ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26032024-12-21T03:02:22.220ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "204402c2-18f8-4ca4-b92a-d6fe3b30c32a", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:21 GMT"} })
26042024-12-21T03:02:22.220ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26052024-12-21T03:02:22.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
26062024-12-21T03:02:22.266ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26072024-12-21T03:02:22.266ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26082024-12-21T03:02:22.266ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc290dab-1b2c-4a54-82ca-bc644ae54f39", "content-length": "691", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26092024-12-21T03:02:22.266ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26102024-12-21T03:02:22.266ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26112024-12-21T03:02:22.266ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26122024-12-21T03:02:22.266ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5025be49-319c-4c3d-ad22-4d928dd0bb58", "content-length": "2", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26132024-12-21T03:02:22.272ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 433.783357ms iteration = 26 status = {}
26142024-12-21T03:02:22.272ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.325875ms iteration = 27 status = {}
26152024-12-21T03:02:22.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26162024-12-21T03:02:22.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26172024-12-21T03:02:22.275ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 436.721563ms iteration = 26 status = null
26182024-12-21T03:02:22.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26192024-12-21T03:02:22.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26202024-12-21T03:02:22.351ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
26212024-12-21T03:02:22.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26222024-12-21T03:02:22.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26232024-12-21T03:02:22.360ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26242024-12-21T03:02:22.360ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "99587bb4-925a-4932-8a86-94966205fd62", "content-length": "134", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26252024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26262024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
26272024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26282024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26292024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26302024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26312024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26322024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26332024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26342024-12-21T03:02:22.360ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26352024-12-21T03:02:22.361ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
26362024-12-21T03:02:22.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26372024-12-21T03:02:22.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26382024-12-21T03:02:22.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26392024-12-21T03:02:22.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b414db9-fc10-4a11-b5c2-a4c362ea505d", "content-length": "2", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26402024-12-21T03:02:22.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26412024-12-21T03:02:22.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "14862f12-22dd-4673-b5db-c69ae9b40fcf", "content-length": "52", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26422024-12-21T03:02:22.363ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
26432024-12-21T03:02:22.363ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26442024-12-21T03:02:22.487ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "99eecedb-8ac4-42a9-ba0a-ce320146179f", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26452024-12-21T03:02:22.487ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
26462024-12-21T03:02:22.487ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26472024-12-21T03:02:22.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a950e5-c79a-4d71-bede-2612f8f4dd1a", "content-length": "682", "date": "Sat, 21 Dec 2024 03:02:22 GMT"} })
26482024-12-21T03:02:22.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26492024-12-21T03:02:22.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26502024-12-21T03:02:22.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26512024-12-21T03:02:22.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26522024-12-21T03:02:22.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26532024-12-21T03:02:22.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26542024-12-21T03:02:22.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9eebf314-088a-41f1-a2cc-dbf016de5ccd roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26552024-12-21T03:02:22.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9eebf314-088a-41f1-a2cc-dbf016de5ccd resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26562024-12-21T03:02:22.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26572024-12-21T03:02:22.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26582024-12-21T03:02:22.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9eebf314-088a-41f1-a2cc-dbf016de5ccd response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26592024-12-21T03:02:22.510ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.724358ms iteration = 26 status = {}
26602024-12-21T03:02:23.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e18fabb2-a3bb-4dfe-9b95-a3ad7e72b88b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26612024-12-21T03:02:23.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e18fabb2-a3bb-4dfe-9b95-a3ad7e72b88b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26622024-12-21T03:02:23.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e18fabb2-a3bb-4dfe-9b95-a3ad7e72b88b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26632024-12-21T03:02:24.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1495 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 83501d8e-bbc6-4562-9e1d-93c07abc1912 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
26642024-12-21T03:02:24.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c9aa8e96-086f-45e8-b179-3bcdef77152f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26652024-12-21T03:02:24.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c9aa8e96-086f-45e8-b179-3bcdef77152f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26662024-12-21T03:02:24.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c9aa8e96-086f-45e8-b179-3bcdef77152f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26672024-12-21T03:02:25.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 176075f1-7a28-462f-91a6-32bf74a093a1 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26682024-12-21T03:02:25.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 176075f1-7a28-462f-91a6-32bf74a093a1 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26692024-12-21T03:02:25.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 176075f1-7a28-462f-91a6-32bf74a093a1 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26702024-12-21T03:02:26.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d4944f3-a860-4e59-8238-0e1bc5bbdaf0 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26712024-12-21T03:02:26.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d4944f3-a860-4e59-8238-0e1bc5bbdaf0 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26722024-12-21T03:02:26.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d4944f3-a860-4e59-8238-0e1bc5bbdaf0 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26732024-12-21T03:02:26.976ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
26742024-12-21T03:02:26.976ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
26752024-12-21T03:02:27.008ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
26762024-12-21T03:02:27.008ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:58433
26772024-12-21T03:02:27.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58433 req_id = 874347a0-ce59-4850-a06d-8b3b0470dfdf roles = RoleSet { roles: {} } uri = /metrics/producers
26782024-12-21T03:02:27.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58433 req_id = 874347a0-ce59-4850-a06d-8b3b0470dfdf resource = Database result = Ok(()) uri = /metrics/producers
26792024-12-21T03:02:27.045ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 4f50fa81-5371-4a88-a8b4-4e3726e451a5
26802024-12-21T03:02:27.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36765 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58433 req_id = 874347a0-ce59-4850-a06d-8b3b0470dfdf response_code = 201 uri = /metrics/producers
26812024-12-21T03:02:27.045ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "874347a0-ce59-4850-a06d-8b3b0470dfdf", "content-length": "41", "date": "Sat, 21 Dec 2024 03:02:27 GMT"} })
26822024-12-21T03:02:27.047ZDEBGnexus (producer-registration-task): registered with nexus successfully
26832024-12-21T03:02:27.047ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26842024-12-21T03:02:27.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a5de35da-7520-402d-84e9-46d40966620d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26852024-12-21T03:02:27.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a5de35da-7520-402d-84e9-46d40966620d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26862024-12-21T03:02:27.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a5de35da-7520-402d-84e9-46d40966620d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26872024-12-21T03:02:28.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 138cec5d-4c5a-4412-887d-78178f110f0f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26882024-12-21T03:02:28.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 138cec5d-4c5a-4412-887d-78178f110f0f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26892024-12-21T03:02:28.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 138cec5d-4c5a-4412-887d-78178f110f0f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26902024-12-21T03:02:29.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41abc6f7-8d73-480d-9195-a3e86270797f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26912024-12-21T03:02:29.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41abc6f7-8d73-480d-9195-a3e86270797f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26922024-12-21T03:02:29.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41abc6f7-8d73-480d-9195-a3e86270797f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26932024-12-21T03:02:30.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b7043c2a-4308-4b9a-82c2-4b82e33b6197 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26942024-12-21T03:02:30.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b7043c2a-4308-4b9a-82c2-4b82e33b6197 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26952024-12-21T03:02:30.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b7043c2a-4308-4b9a-82c2-4b82e33b6197 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26962024-12-21T03:02:31.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5826daf5-5c4f-4571-a7e7-c41146fe1319 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26972024-12-21T03:02:31.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5826daf5-5c4f-4571-a7e7-c41146fe1319 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26982024-12-21T03:02:31.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5826daf5-5c4f-4571-a7e7-c41146fe1319 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26992024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
27002024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
27012024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27022024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27032024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27042024-12-21T03:02:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27052024-12-21T03:02:31.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27062024-12-21T03:02:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27072024-12-21T03:02:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27082024-12-21T03:02:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.025297ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27092024-12-21T03:02:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27102024-12-21T03:02:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27112024-12-21T03:02:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27122024-12-21T03:02:31.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27132024-12-21T03:02:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27142024-12-21T03:02:31.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-12-21T03:02:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
27162024-12-21T03:02:31.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27172024-12-21T03:02:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27182024-12-21T03:02:31.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
27192024-12-21T03:02:31.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.567433ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
27202024-12-21T03:02:32.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b9d5a01-8b38-4748-98c3-2c79837c7a0d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27212024-12-21T03:02:32.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b9d5a01-8b38-4748-98c3-2c79837c7a0d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27222024-12-21T03:02:32.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6b9d5a01-8b38-4748-98c3-2c79837c7a0d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27232024-12-21T03:02:33.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 713f7791-eed1-43b1-84db-c1cfa2f5e661 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27242024-12-21T03:02:33.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 713f7791-eed1-43b1-84db-c1cfa2f5e661 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27252024-12-21T03:02:33.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 713f7791-eed1-43b1-84db-c1cfa2f5e661 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27262024-12-21T03:02:34.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 7400f694-50c9-4b53-8dcd-b2ebeda3a445 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
27272024-12-21T03:02:34.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 7400f694-50c9-4b53-8dcd-b2ebeda3a445 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
27282024-12-21T03:02:34.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 7400f694-50c9-4b53-8dcd-b2ebeda3a445 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
27292024-12-21T03:02:34.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 80e1b0c1-26e1-4847-a265-0dd053c3f570 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
27302024-12-21T03:02:34.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 80e1b0c1-26e1-4847-a265-0dd053c3f570 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
27312024-12-21T03:02:34.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 80e1b0c1-26e1-4847-a265-0dd053c3f570 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
27322024-12-21T03:02:34.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1327 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 91fd1f8d-8930-4378-8b97-5d3ebe3f67fa response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
27332024-12-21T03:02:34.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17f71a69-b08b-4bd6-b8b5-aa15a039b19e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27342024-12-21T03:02:34.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17f71a69-b08b-4bd6-b8b5-aa15a039b19e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27352024-12-21T03:02:34.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17f71a69-b08b-4bd6-b8b5-aa15a039b19e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27362024-12-21T03:02:35.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a27d8cd-13ba-4b0e-b538-1dd991f3e241 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27372024-12-21T03:02:35.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a27d8cd-13ba-4b0e-b538-1dd991f3e241 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27382024-12-21T03:02:35.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a27d8cd-13ba-4b0e-b538-1dd991f3e241 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27392024-12-21T03:02:36.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2cdb28aa-9a11-4f13-90b9-80f630c75c61 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27402024-12-21T03:02:36.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2cdb28aa-9a11-4f13-90b9-80f630c75c61 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27412024-12-21T03:02:36.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2cdb28aa-9a11-4f13-90b9-80f630c75c61 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27422024-12-21T03:02:37.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c26475c-d9ec-4165-8ea1-fa0c81fa8f6e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27432024-12-21T03:02:37.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c26475c-d9ec-4165-8ea1-fa0c81fa8f6e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27442024-12-21T03:02:37.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1c26475c-d9ec-4165-8ea1-fa0c81fa8f6e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27452024-12-21T03:02:38.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 405144ef-4152-4e71-bab9-477ed3da0b44 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27462024-12-21T03:02:38.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 405144ef-4152-4e71-bab9-477ed3da0b44 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27472024-12-21T03:02:38.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 405144ef-4152-4e71-bab9-477ed3da0b44 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27482024-12-21T03:02:39.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f96074f7-76af-47c5-a2db-6eb1efd8a94c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27492024-12-21T03:02:39.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f96074f7-76af-47c5-a2db-6eb1efd8a94c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27502024-12-21T03:02:39.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f96074f7-76af-47c5-a2db-6eb1efd8a94c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27512024-12-21T03:02:40.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 81222a26-05e3-4096-9f7b-990e9d6b4621 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27522024-12-21T03:02:40.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 81222a26-05e3-4096-9f7b-990e9d6b4621 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27532024-12-21T03:02:40.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 81222a26-05e3-4096-9f7b-990e9d6b4621 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27542024-12-21T03:02:41.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = e1ce825a-b1d9-4367-a506-c2e13925bdfa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27552024-12-21T03:02:41.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = e1ce825a-b1d9-4367-a506-c2e13925bdfa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27562024-12-21T03:02:41.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = e1ce825a-b1d9-4367-a506-c2e13925bdfa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27572024-12-21T03:02:41.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
27582024-12-21T03:02:41.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27592024-12-21T03:02:41.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
27602024-12-21T03:02:41.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27612024-12-21T03:02:41.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27622024-12-21T03:02:41.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27632024-12-21T03:02:41.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27642024-12-21T03:02:41.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652024-12-21T03:02:41.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27662024-12-21T03:02:41.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.850305ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27672024-12-21T03:02:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27682024-12-21T03:02:41.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692024-12-21T03:02:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27702024-12-21T03:02:41.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27712024-12-21T03:02:41.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27722024-12-21T03:02:41.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27732024-12-21T03:02:41.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
27742024-12-21T03:02:41.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27752024-12-21T03:02:41.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27762024-12-21T03:02:41.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
27772024-12-21T03:02:41.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.034485ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
27782024-12-21T03:02:41.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2033bd6f-03e9-4f94-83ac-df7299e2631b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27792024-12-21T03:02:41.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2033bd6f-03e9-4f94-83ac-df7299e2631b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27802024-12-21T03:02:41.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 2033bd6f-03e9-4f94-83ac-df7299e2631b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27812024-12-21T03:02:42.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b14775d-f331-431e-9d17-8e09c1d26f6f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27822024-12-21T03:02:42.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b14775d-f331-431e-9d17-8e09c1d26f6f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27832024-12-21T03:02:42.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b14775d-f331-431e-9d17-8e09c1d26f6f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27842024-12-21T03:02:43.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4e2942d-0a5c-478d-9d7b-ff7f341edd84 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27852024-12-21T03:02:43.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4e2942d-0a5c-478d-9d7b-ff7f341edd84 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27862024-12-21T03:02:43.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4e2942d-0a5c-478d-9d7b-ff7f341edd84 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27872024-12-21T03:02:44.037ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1284 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = dc1b90c2-0247-4851-a8eb-469988343e83 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
27882024-12-21T03:02:44.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 338f8a8a-6b42-41b7-a42f-d3d192eca76d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27892024-12-21T03:02:44.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 338f8a8a-6b42-41b7-a42f-d3d192eca76d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27902024-12-21T03:02:44.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 338f8a8a-6b42-41b7-a42f-d3d192eca76d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27912024-12-21T03:02:46.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1543891-9715-468d-829d-92832a1c2240 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27922024-12-21T03:02:46.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1543891-9715-468d-829d-92832a1c2240 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27932024-12-21T03:02:46.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c1543891-9715-468d-829d-92832a1c2240 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27942024-12-21T03:02:47.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = aced2fd7-70f1-49ef-9eee-68904f6134a2 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27952024-12-21T03:02:47.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = aced2fd7-70f1-49ef-9eee-68904f6134a2 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27962024-12-21T03:02:47.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = aced2fd7-70f1-49ef-9eee-68904f6134a2 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27972024-12-21T03:02:48.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 65f9aa73-3dda-4c65-8413-a53bb04342d3 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27982024-12-21T03:02:48.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 65f9aa73-3dda-4c65-8413-a53bb04342d3 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27992024-12-21T03:02:48.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 65f9aa73-3dda-4c65-8413-a53bb04342d3 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28002024-12-21T03:02:49.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e96c92db-12ac-4fca-b9ca-d314cd23895a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28012024-12-21T03:02:49.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e96c92db-12ac-4fca-b9ca-d314cd23895a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28022024-12-21T03:02:49.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e96c92db-12ac-4fca-b9ca-d314cd23895a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28032024-12-21T03:02:50.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e56113f7-0db4-4c5c-ad64-9e0731a5b814 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28042024-12-21T03:02:50.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e56113f7-0db4-4c5c-ad64-9e0731a5b814 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28052024-12-21T03:02:50.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e56113f7-0db4-4c5c-ad64-9e0731a5b814 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28062024-12-21T03:02:50.244ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55340
28072024-12-21T03:02:50.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55340 req_id = 0150e859-b602-43a0-a60d-39e9c21340fd roles = RoleSet { roles: {} } uri = /metrics/producers
28082024-12-21T03:02:50.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55340 req_id = 0150e859-b602-43a0-a60d-39e9c21340fd resource = Database result = Ok(()) uri = /metrics/producers
28092024-12-21T03:02:50.283ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28102024-12-21T03:02:50.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39748 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55340 req_id = 0150e859-b602-43a0-a60d-39e9c21340fd response_code = 201 uri = /metrics/producers
28112024-12-21T03:02:51.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = edabf1c0-565a-4ede-8373-43addba97981 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28122024-12-21T03:02:51.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = edabf1c0-565a-4ede-8373-43addba97981 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28132024-12-21T03:02:51.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = edabf1c0-565a-4ede-8373-43addba97981 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
28142024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
28152024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
28162024-12-21T03:02:51.838ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28172024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28182024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28192024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
28202024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
28212024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28222024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
28232024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
28242024-12-21T03:02:51.838ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = aa6a1816-1ed4-446b-8121-599a04d2c280
28252024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28262024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
28272024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.08\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280"}
28282024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
28292024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28302024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28312024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
28322024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
28332024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28342024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
28352024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28362024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28372024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
28382024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28392024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
28402024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28412024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
28422024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
28432024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28442024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
28452024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28462024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
28472024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28482024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
28492024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
28502024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28512024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28522024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
28532024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28542024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
28552024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28562024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
28572024-12-21T03:02:51.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
28582024-12-21T03:02:51.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28592024-12-21T03:02:51.839ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 02:52:51.838778706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28602024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28612024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28622024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
28632024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28642024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28652024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
28662024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
28672024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28682024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28692024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
28702024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
28712024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28722024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
28732024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28742024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
28752024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28762024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
28772024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28782024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28792024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28802024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28812024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28822024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
28832024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28842024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28852024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28862024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28872024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28882024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28892024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28902024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28912024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28922024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28932024-12-21T03:02:51.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d789b63-e234-471f-abd5-426e10c5c6e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1817, tv_nsec: 896756752 } })
28942024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28952024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28962024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
28972024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28982024-12-21T03:02:51.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bf02835-271c-4b1b-a7ae-b005eed1920c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da604828-d4f1-4898-b180-39aa8632768d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1817, tv_nsec: 896780832 } })
28992024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29002024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29012024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29022024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29032024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29042024-12-21T03:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29052024-12-21T03:02:51.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29062024-12-21T03:02:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.562168ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29072024-12-21T03:02:51.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
29082024-12-21T03:02:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.7155ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
29092024-12-21T03:02:51.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1817, tv_nsec: 898920737 } })
29102024-12-21T03:02:51.841ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112024-12-21T03:02:51.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
29122024-12-21T03:02:51.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29132024-12-21T03:02:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.731056ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29142024-12-21T03:02:51.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152024-12-21T03:02:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.1512ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
29162024-12-21T03:02:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29172024-12-21T03:02:51.844ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29182024-12-21T03:02:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29192024-12-21T03:02:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29202024-12-21T03:02:51.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29212024-12-21T03:02:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29222024-12-21T03:02:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29232024-12-21T03:02:51.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29242024-12-21T03:02:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29252024-12-21T03:02:51.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29262024-12-21T03:02:51.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29272024-12-21T03:02:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29282024-12-21T03:02:51.850ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1817, tv_nsec: 907286005 } })
29292024-12-21T03:02:51.850ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 02:52:51.838778706 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29302024-12-21T03:02:51.850ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.670216ms iteration = 14 status = {"expiration":"2024-12-21T02:52:51.838778706Z","pruned":[]}
29312024-12-21T03:02:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29322024-12-21T03:02:51.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29332024-12-21T03:02:51.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
29342024-12-21T03:02:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29352024-12-21T03:02:51.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29362024-12-21T03:02:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29372024-12-21T03:02:51.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29382024-12-21T03:02:51.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29392024-12-21T03:02:51.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29402024-12-21T03:02:51.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29412024-12-21T03:02:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29422024-12-21T03:02:51.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29432024-12-21T03:02:51.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29442024-12-21T03:02:51.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29452024-12-21T03:02:51.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-12-21T03:02:51.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-21T03:02:51.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482024-12-21T03:02:51.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492024-12-21T03:02:51.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29502024-12-21T03:02:51.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1817, tv_nsec: 923126940 } })
29512024-12-21T03:02:51.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
29522024-12-21T03:02:51.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29532024-12-21T03:02:51.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29542024-12-21T03:02:51.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29552024-12-21T03:02:51.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29562024-12-21T03:02:51.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29572024-12-21T03:02:51.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29582024-12-21T03:02:51.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29592024-12-21T03:02:51.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29602024-12-21T03:02:51.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29612024-12-21T03:02:51.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29622024-12-21T03:02:51.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29632024-12-21T03:02:51.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29642024-12-21T03:02:51.879ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29652024-12-21T03:02:51.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29662024-12-21T03:02:51.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
29672024-12-21T03:02:51.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29682024-12-21T03:02:51.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29692024-12-21T03:02:51.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.673028ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
29702024-12-21T03:02:51.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712024-12-21T03:02:51.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722024-12-21T03:02:51.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29732024-12-21T03:02:51.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29742024-12-21T03:02:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29752024-12-21T03:02:51.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29762024-12-21T03:02:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29772024-12-21T03:02:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29782024-12-21T03:02:51.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29792024-12-21T03:02:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29802024-12-21T03:02:51.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.511237ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29812024-12-21T03:02:51.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.537937ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
29822024-12-21T03:02:51.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29832024-12-21T03:02:51.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29842024-12-21T03:02:51.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29852024-12-21T03:02:51.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29862024-12-21T03:02:51.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29872024-12-21T03:02:51.911ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
29882024-12-21T03:02:51.911ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
29892024-12-21T03:02:51.911ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.117044ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
29902024-12-21T03:02:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29912024-12-21T03:02:51.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-12-21T03:02:51.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29932024-12-21T03:02:51.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29942024-12-21T03:02:51.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29952024-12-21T03:02:51.925ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
29962024-12-21T03:02:51.925ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
29972024-12-21T03:02:51.925ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.589401ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
29982024-12-21T03:02:51.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
29992024-12-21T03:02:51.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.927316ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
30002024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30012024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30022024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30032024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30042024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30052024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30062024-12-21T03:02:51.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30072024-12-21T03:02:51.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082024-12-21T03:02:51.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30092024-12-21T03:02:51.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30102024-12-21T03:02:51.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30112024-12-21T03:02:51.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30122024-12-21T03:02:51.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30132024-12-21T03:02:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30142024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30152024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30162024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30172024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30182024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30192024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30202024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30212024-12-21T03:02:51.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30222024-12-21T03:02:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30232024-12-21T03:02:51.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30242024-12-21T03:02:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30252024-12-21T03:02:51.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30262024-12-21T03:02:51.937ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30272024-12-21T03:02:51.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30282024-12-21T03:02:51.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30292024-12-21T03:02:51.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30302024-12-21T03:02:51.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312024-12-21T03:02:51.944ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30322024-12-21T03:02:51.944ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.061399ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30332024-12-21T03:02:51.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30342024-12-21T03:02:51.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30352024-12-21T03:02:51.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30362024-12-21T03:02:51.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30372024-12-21T03:02:51.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30382024-12-21T03:02:51.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30392024-12-21T03:02:51.962ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30402024-12-21T03:02:51.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30412024-12-21T03:02:51.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30422024-12-21T03:02:51.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30432024-12-21T03:02:51.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30442024-12-21T03:02:51.971ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30452024-12-21T03:02:51.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30462024-12-21T03:02:51.981ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30472024-12-21T03:02:51.981ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30482024-12-21T03:02:51.981ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30492024-12-21T03:02:51.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30502024-12-21T03:02:51.984ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
30512024-12-21T03:02:51.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.795562ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30522024-12-21T03:02:52.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
30532024-12-21T03:02:52.010ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30542024-12-21T03:02:52.011ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d24fdb8d-c69e-41e2-88a3-29f936434864", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
30552024-12-21T03:02:52.011ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30562024-12-21T03:02:52.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
30572024-12-21T03:02:52.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30582024-12-21T03:02:52.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30592024-12-21T03:02:52.026ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
30602024-12-21T03:02:52.026ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30612024-12-21T03:02:52.026ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b6a96cc-46db-4970-aa05-b55c49a39309", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
30622024-12-21T03:02:52.026ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30632024-12-21T03:02:52.028ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30642024-12-21T03:02:52.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
30652024-12-21T03:02:52.082ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
30662024-12-21T03:02:52.082ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30672024-12-21T03:02:52.082ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1de1c9ea-cc1f-4477-8a26-1bfcb1deb63a", "content-length": "26", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
30682024-12-21T03:02:52.082ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30692024-12-21T03:02:52.085ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30702024-12-21T03:02:52.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3e87811-8362-4b1f-b468-ea55a7005c04 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
30712024-12-21T03:02:52.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3e87811-8362-4b1f-b468-ea55a7005c04 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
30722024-12-21T03:02:52.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30732024-12-21T03:02:52.163ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30742024-12-21T03:02:52.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30752024-12-21T03:02:52.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfb3cc6e-48f0-46d3-acf6-3fa056e516b4", "content-length": "372", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
30762024-12-21T03:02:52.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30772024-12-21T03:02:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30782024-12-21T03:02:52.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30792024-12-21T03:02:52.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30802024-12-21T03:02:52.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30812024-12-21T03:02:52.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3e87811-8362-4b1f-b468-ea55a7005c04 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
30822024-12-21T03:02:52.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30832024-12-21T03:02:52.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30842024-12-21T03:02:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30852024-12-21T03:02:52.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 360.073127ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30862024-12-21T03:02:52.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-12-21T03:02:52.201ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30882024-12-21T03:02:52.201ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 0 version = 2
30892024-12-21T03:02:52.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30902024-12-21T03:02:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30912024-12-21T03:02:52.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30922024-12-21T03:02:52.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30932024-12-21T03:02:52.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30942024-12-21T03:02:52.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952024-12-21T03:02:52.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 367.17597ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30962024-12-21T03:02:52.207ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30972024-12-21T03:02:52.207ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30982024-12-21T03:02:52.207ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 368.423035ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30992024-12-21T03:02:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31002024-12-21T03:02:52.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31012024-12-21T03:02:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31022024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 1 version = 2
31032024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31042024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 02:49:54.573469 UTC dns_group = external generation = 2
31052024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 371.738733ms iteration = 15 status = {"generation":2}
31062024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31072024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31082024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31092024-12-21T03:02:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31102024-12-21T03:02:52.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-12-21T03:02:52.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31122024-12-21T03:02:52.213ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31132024-12-21T03:02:52.214ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7bafb1a3-5a25-4c10-9f34-fd3937e8e4f4", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31142024-12-21T03:02:52.214ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31152024-12-21T03:02:52.214ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
31162024-12-21T03:02:52.214ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 376.460679ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
31172024-12-21T03:02:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31182024-12-21T03:02:52.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31192024-12-21T03:02:52.215ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ff5566e5-544f-461a-abed-907b7ee4fac6", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31202024-12-21T03:02:52.215ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31212024-12-21T03:02:52.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31222024-12-21T03:02:52.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
31232024-12-21T03:02:52.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31242024-12-21T03:02:52.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31252024-12-21T03:02:52.218ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31262024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 379.566495ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31272024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 379.626485ms iteration = 27 status = 0
31282024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31292024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31302024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 02:49:52.719690 UTC dns_group = internal generation = 1
31312024-12-21T03:02:52.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 379.823238ms iteration = 15 status = {"generation":1}
31322024-12-21T03:02:52.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31332024-12-21T03:02:52.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31342024-12-21T03:02:52.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31352024-12-21T03:02:52.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31362024-12-21T03:02:52.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31372024-12-21T03:02:52.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31382024-12-21T03:02:52.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "84488924-76eb-4b1b-806e-21ef0402364e", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
31392024-12-21T03:02:52.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31402024-12-21T03:02:52.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31412024-12-21T03:02:52.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31422024-12-21T03:02:52.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31432024-12-21T03:02:52.237ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T02:49:48.310639Z, time_modified: 2024-12-21T02:49:48.310639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }) }
31442024-12-21T03:02:52.237ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 398.546006ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]}},"default_endpoint":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31452024-12-21T03:02:52.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31462024-12-21T03:02:52.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31472024-12-21T03:02:52.243ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31482024-12-21T03:02:52.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31492024-12-21T03:02:52.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bbd7033c-e1ec-475a-9ce5-7d7ca7aa6042", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
31502024-12-21T03:02:52.245ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.57821ms iteration = 29 status = {}
31512024-12-21T03:02:52.263ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31522024-12-21T03:02:52.263ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc1273ec-748a-469f-b056-ec2d89bb6250", "content-length": "2", "date": "Sat, 21 Dec 2024 03:02:51 GMT"} })
31532024-12-21T03:02:52.265ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31542024-12-21T03:02:52.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31552024-12-21T03:02:52.266ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31562024-12-21T03:02:52.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 428.384215ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31572024-12-21T03:02:52.267ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 428.83231ms iteration = 27 status = null
31582024-12-21T03:02:52.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 435.871612ms iteration = 31 status = {"physical_disks_added":0}
31592024-12-21T03:02:52.276ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31602024-12-21T03:02:52.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "196e98aa-3aff-4184-8c20-f70c16d6589d", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31612024-12-21T03:02:52.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31622024-12-21T03:02:52.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba26a6ed-6377-4977-90b7-86aa858f5b00", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31632024-12-21T03:02:52.279ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31642024-12-21T03:02:52.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "48f2913e-c602-437e-bdd0-55092f339f4b", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31652024-12-21T03:02:52.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31662024-12-21T03:02:52.282ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31672024-12-21T03:02:52.282ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 443.604383ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31682024-12-21T03:02:52.296ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.402564ms iteration = 27 status = {}
31692024-12-21T03:02:52.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31702024-12-21T03:02:52.326ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "91cbeb7e-efe9-4661-a347-640fbede4c75", "content-length": "691", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
31712024-12-21T03:02:52.326ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31722024-12-21T03:02:52.326ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31732024-12-21T03:02:52.326ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31742024-12-21T03:02:52.328ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 489.261187ms iteration = 28 status = {}
31752024-12-21T03:02:52.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31762024-12-21T03:02:52.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31772024-12-21T03:02:52.332ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
31782024-12-21T03:02:52.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31792024-12-21T03:02:52.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31802024-12-21T03:02:52.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31812024-12-21T03:02:52.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ce5f4a-0620-4288-8797-25bae39831e7", "content-length": "134", "date": "Sat, 21 Dec 2024 03:02:51 GMT"} })
31822024-12-21T03:02:52.342ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31832024-12-21T03:02:52.342ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
31842024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31852024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31862024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31872024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31882024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31892024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31902024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31912024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31922024-12-21T03:02:52.343ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
31932024-12-21T03:02:52.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31942024-12-21T03:02:52.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31952024-12-21T03:02:52.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31962024-12-21T03:02:52.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62c55e4-791d-44f0-b105-61a28cf3b592", "content-length": "2", "date": "Sat, 21 Dec 2024 03:02:51 GMT"} })
31972024-12-21T03:02:52.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31982024-12-21T03:02:52.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "178bf2f2-6430-45fe-b686-9b96e88cbe14", "content-length": "52", "date": "Sat, 21 Dec 2024 03:02:51 GMT"} })
31992024-12-21T03:02:52.345ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
32002024-12-21T03:02:52.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32012024-12-21T03:02:52.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f1098116-6e16-4aff-a6c5-9cf7eb147ca0", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
32022024-12-21T03:02:52.467ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
32032024-12-21T03:02:52.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32042024-12-21T03:02:52.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b267cb7a-9198-426f-9e4a-1f7d5ef62a26", "content-length": "682", "date": "Sat, 21 Dec 2024 03:02:52 GMT"} })
32052024-12-21T03:02:52.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32062024-12-21T03:02:52.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32072024-12-21T03:02:52.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32082024-12-21T03:02:52.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32092024-12-21T03:02:52.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32102024-12-21T03:02:52.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32112024-12-21T03:02:52.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32122024-12-21T03:02:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32132024-12-21T03:02:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 769.964726ms iteration = 27 status = {}
32142024-12-21T03:02:53.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 643cb373-ffe7-4044-acb5-8a56f6948be0 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32152024-12-21T03:02:53.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 643cb373-ffe7-4044-acb5-8a56f6948be0 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32162024-12-21T03:02:53.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 643cb373-ffe7-4044-acb5-8a56f6948be0 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32172024-12-21T03:02:54.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1296 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 2e90b7f7-2852-47ae-84eb-2607d8d7d2f8 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
32182024-12-21T03:02:54.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ea6c2b7b-3b24-409e-836d-0885cec2a4d1 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32192024-12-21T03:02:54.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ea6c2b7b-3b24-409e-836d-0885cec2a4d1 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32202024-12-21T03:02:54.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ea6c2b7b-3b24-409e-836d-0885cec2a4d1 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32212024-12-21T03:02:54.243ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43413
32222024-12-21T03:02:54.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43413 req_id = 8974c90c-967f-4d73-a451-fbdec10336d1 roles = RoleSet { roles: {} } uri = /metrics/producers
32232024-12-21T03:02:54.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43413 req_id = 8974c90c-967f-4d73-a451-fbdec10336d1 resource = Database result = Ok(()) uri = /metrics/producers
32242024-12-21T03:02:54.252ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 15f87f8f-adb4-4daa-a123-a8c44178aea2
32252024-12-21T03:02:54.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9042 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43413 req_id = 8974c90c-967f-4d73-a451-fbdec10336d1 response_code = 201 uri = /metrics/producers
32262024-12-21T03:02:55.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 64fcb3b6-6206-437a-9500-fbe4337cc382 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32272024-12-21T03:02:55.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 64fcb3b6-6206-437a-9500-fbe4337cc382 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32282024-12-21T03:02:55.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 64fcb3b6-6206-437a-9500-fbe4337cc382 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32292024-12-21T03:02:56.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc74c5b1-91f2-443a-ae41-bce06c03d606 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32302024-12-21T03:02:56.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc74c5b1-91f2-443a-ae41-bce06c03d606 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32312024-12-21T03:02:56.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc74c5b1-91f2-443a-ae41-bce06c03d606 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32322024-12-21T03:02:57.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c49bfe6f-dde1-42cf-956e-93b4b636b302 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32332024-12-21T03:02:57.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c49bfe6f-dde1-42cf-956e-93b4b636b302 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32342024-12-21T03:02:57.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c49bfe6f-dde1-42cf-956e-93b4b636b302 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32352024-12-21T03:02:58.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3c29a909-4bae-429f-a727-1bf9edb986a5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32362024-12-21T03:02:58.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3c29a909-4bae-429f-a727-1bf9edb986a5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32372024-12-21T03:02:58.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3c29a909-4bae-429f-a727-1bf9edb986a5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32382024-12-21T03:02:58.478ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57060
32392024-12-21T03:02:58.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57060 req_id = cb5d86c3-bc7b-405c-aaef-7fcbb8f0c207 roles = RoleSet { roles: {} } uri = /metrics/producers
32402024-12-21T03:02:58.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57060 req_id = cb5d86c3-bc7b-405c-aaef-7fcbb8f0c207 resource = Database result = Ok(()) uri = /metrics/producers
32412024-12-21T03:02:58.490ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = e07f98b9-1bde-49d3-9706-a165e3c36c5a
32422024-12-21T03:02:58.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11390 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57060 req_id = cb5d86c3-bc7b-405c-aaef-7fcbb8f0c207 response_code = 201 uri = /metrics/producers
32432024-12-21T03:02:58.681ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33313
32442024-12-21T03:02:58.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33313 req_id = fd92cdb8-09cc-4200-bddd-8375d16d79d5 roles = RoleSet { roles: {} } uri = /metrics/producers
32452024-12-21T03:02:58.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33313 req_id = fd92cdb8-09cc-4200-bddd-8375d16d79d5 resource = Database result = Ok(()) uri = /metrics/producers
32462024-12-21T03:02:58.722ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = e9078b79-b4a7-485d-9b9d-029484c590d3
32472024-12-21T03:02:58.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40869 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33313 req_id = fd92cdb8-09cc-4200-bddd-8375d16d79d5 response_code = 201 uri = /metrics/producers
32482024-12-21T03:02:59.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 35e3199d-9aa6-49e3-ad6e-1151ff041b8f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32492024-12-21T03:02:59.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 35e3199d-9aa6-49e3-ad6e-1151ff041b8f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32502024-12-21T03:02:59.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 35e3199d-9aa6-49e3-ad6e-1151ff041b8f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32512024-12-21T03:03:00.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3695d74-4761-4cfc-97e8-b46c6a5de42c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32522024-12-21T03:03:00.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3695d74-4761-4cfc-97e8-b46c6a5de42c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32532024-12-21T03:03:00.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c3695d74-4761-4cfc-97e8-b46c6a5de42c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32542024-12-21T03:03:01.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5ebc19d-6580-4883-b000-3cbca3622788 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32552024-12-21T03:03:01.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5ebc19d-6580-4883-b000-3cbca3622788 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32562024-12-21T03:03:01.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e5ebc19d-6580-4883-b000-3cbca3622788 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32572024-12-21T03:03:01.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
32582024-12-21T03:03:01.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32592024-12-21T03:03:01.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
32602024-12-21T03:03:01.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32612024-12-21T03:03:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32622024-12-21T03:03:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32632024-12-21T03:03:01.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32642024-12-21T03:03:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32652024-12-21T03:03:01.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32662024-12-21T03:03:01.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32672024-12-21T03:03:01.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32682024-12-21T03:03:01.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32692024-12-21T03:03:01.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32702024-12-21T03:03:01.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
32712024-12-21T03:03:01.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32722024-12-21T03:03:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32732024-12-21T03:03:01.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
32742024-12-21T03:03:01.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.324643ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
32752024-12-21T03:03:01.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32762024-12-21T03:03:01.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32772024-12-21T03:03:01.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.905753ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32782024-12-21T03:03:02.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a46414f-130f-47c0-8fe0-ab66df0c7473 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32792024-12-21T03:03:02.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a46414f-130f-47c0-8fe0-ab66df0c7473 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32802024-12-21T03:03:02.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a46414f-130f-47c0-8fe0-ab66df0c7473 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32812024-12-21T03:03:03.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e55a543e-fa35-4dcb-beda-c622b067e47e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32822024-12-21T03:03:03.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e55a543e-fa35-4dcb-beda-c622b067e47e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32832024-12-21T03:03:03.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e55a543e-fa35-4dcb-beda-c622b067e47e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32842024-12-21T03:03:04.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 5fe85e4f-a82f-418d-a1d7-c428d89efc30 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
32852024-12-21T03:03:04.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1cde7fc-d12d-42f9-a1ac-5c97438178c9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32862024-12-21T03:03:04.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1cde7fc-d12d-42f9-a1ac-5c97438178c9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32872024-12-21T03:03:04.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1cde7fc-d12d-42f9-a1ac-5c97438178c9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32882024-12-21T03:03:05.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c4e42a91-b563-40cc-9e31-451faef7abfa roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32892024-12-21T03:03:05.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c4e42a91-b563-40cc-9e31-451faef7abfa resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32902024-12-21T03:03:05.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c4e42a91-b563-40cc-9e31-451faef7abfa response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32912024-12-21T03:03:06.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 958b78da-6dfd-48e9-bdca-4df46d7bf1ad roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32922024-12-21T03:03:06.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 958b78da-6dfd-48e9-bdca-4df46d7bf1ad resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32932024-12-21T03:03:06.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 958b78da-6dfd-48e9-bdca-4df46d7bf1ad response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32942024-12-21T03:03:07.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 46c68a18-fee1-4b37-8612-ad032927e825 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32952024-12-21T03:03:07.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 46c68a18-fee1-4b37-8612-ad032927e825 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32962024-12-21T03:03:07.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 46c68a18-fee1-4b37-8612-ad032927e825 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32972024-12-21T03:03:08.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d96fd4cb-174f-4023-bfa6-81fe3102161c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32982024-12-21T03:03:08.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d96fd4cb-174f-4023-bfa6-81fe3102161c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
32992024-12-21T03:03:08.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d96fd4cb-174f-4023-bfa6-81fe3102161c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33002024-12-21T03:03:09.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bccef63d-fbb7-4a01-ab23-85b32e1e5cd9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33012024-12-21T03:03:09.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bccef63d-fbb7-4a01-ab23-85b32e1e5cd9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33022024-12-21T03:03:09.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bccef63d-fbb7-4a01-ab23-85b32e1e5cd9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33032024-12-21T03:03:10.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 419155a7-22b1-4674-be62-29e682f116fb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33042024-12-21T03:03:10.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 419155a7-22b1-4674-be62-29e682f116fb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33052024-12-21T03:03:10.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 419155a7-22b1-4674-be62-29e682f116fb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33062024-12-21T03:03:11.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 075f89d9-f9bd-4f66-9004-9616e4fb73e7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
33072024-12-21T03:03:11.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 075f89d9-f9bd-4f66-9004-9616e4fb73e7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
33082024-12-21T03:03:11.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 075f89d9-f9bd-4f66-9004-9616e4fb73e7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
33092024-12-21T03:03:11.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f50deddd-228b-4f4c-a4e9-f43265455a5f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33102024-12-21T03:03:11.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f50deddd-228b-4f4c-a4e9-f43265455a5f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33112024-12-21T03:03:11.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f50deddd-228b-4f4c-a4e9-f43265455a5f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33122024-12-21T03:03:11.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
33132024-12-21T03:03:11.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
33142024-12-21T03:03:11.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33152024-12-21T03:03:11.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33162024-12-21T03:03:11.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33172024-12-21T03:03:11.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33182024-12-21T03:03:11.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-12-21T03:03:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33202024-12-21T03:03:11.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33212024-12-21T03:03:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33222024-12-21T03:03:11.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33232024-12-21T03:03:11.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33242024-12-21T03:03:11.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33252024-12-21T03:03:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
33262024-12-21T03:03:11.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33272024-12-21T03:03:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33282024-12-21T03:03:11.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
33292024-12-21T03:03:11.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.864987ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
33302024-12-21T03:03:11.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33312024-12-21T03:03:11.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33322024-12-21T03:03:11.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.803796ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33332024-12-21T03:03:12.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de157b6c-3537-49fb-99ee-1c8b3d0aa39f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33342024-12-21T03:03:12.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de157b6c-3537-49fb-99ee-1c8b3d0aa39f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33352024-12-21T03:03:12.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = de157b6c-3537-49fb-99ee-1c8b3d0aa39f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33362024-12-21T03:03:13.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f5f597d-2bc9-4272-ab81-81f317f04321 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33372024-12-21T03:03:13.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f5f597d-2bc9-4272-ab81-81f317f04321 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33382024-12-21T03:03:13.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f5f597d-2bc9-4272-ab81-81f317f04321 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33392024-12-21T03:03:14.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1345 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = ded687d9-e491-4c6e-80b9-79d71836858f response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
33402024-12-21T03:03:14.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 93b6ff20-588f-42c6-b480-999c40b31fd8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33412024-12-21T03:03:14.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 93b6ff20-588f-42c6-b480-999c40b31fd8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33422024-12-21T03:03:14.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 93b6ff20-588f-42c6-b480-999c40b31fd8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33432024-12-21T03:03:15.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5e730fe9-9eb8-453b-ad74-dab963402749 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33442024-12-21T03:03:15.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5e730fe9-9eb8-453b-ad74-dab963402749 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33452024-12-21T03:03:15.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5e730fe9-9eb8-453b-ad74-dab963402749 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33462024-12-21T03:03:16.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc24c13b-10fd-4017-934c-79e95cc5bf35 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33472024-12-21T03:03:16.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc24c13b-10fd-4017-934c-79e95cc5bf35 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33482024-12-21T03:03:16.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cc24c13b-10fd-4017-934c-79e95cc5bf35 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33492024-12-21T03:03:17.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9e1b2fe4-f7b0-432b-8245-c6e9f091ad68 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33502024-12-21T03:03:17.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9e1b2fe4-f7b0-432b-8245-c6e9f091ad68 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33512024-12-21T03:03:17.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9e1b2fe4-f7b0-432b-8245-c6e9f091ad68 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33522024-12-21T03:03:18.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 72cbab8a-97a4-4bc0-8119-61adf42dbbcf roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33532024-12-21T03:03:18.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 72cbab8a-97a4-4bc0-8119-61adf42dbbcf resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33542024-12-21T03:03:18.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 72cbab8a-97a4-4bc0-8119-61adf42dbbcf response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33552024-12-21T03:03:18.992ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64797
33562024-12-21T03:03:18.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64797 req_id = e70f3293-f02b-4df5-a37a-a7d9879567d7 roles = RoleSet { roles: {} } uri = /metrics/producers
33572024-12-21T03:03:18.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64797 req_id = e70f3293-f02b-4df5-a37a-a7d9879567d7 resource = Database result = Ok(()) uri = /metrics/producers
33582024-12-21T03:03:19.004ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = 4a72b7dd-4681-40e1-99ca-ee46110d2a13
33592024-12-21T03:03:19.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11395 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64797 req_id = e70f3293-f02b-4df5-a37a-a7d9879567d7 response_code = 201 uri = /metrics/producers
33602024-12-21T03:03:19.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb8f5732-67a0-41e0-9cfc-2eb8f2afba09 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33612024-12-21T03:03:19.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb8f5732-67a0-41e0-9cfc-2eb8f2afba09 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33622024-12-21T03:03:19.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = bb8f5732-67a0-41e0-9cfc-2eb8f2afba09 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33632024-12-21T03:03:20.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ab85411-6f4e-449c-b584-f399a4eb545c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33642024-12-21T03:03:20.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ab85411-6f4e-449c-b584-f399a4eb545c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33652024-12-21T03:03:20.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ab85411-6f4e-449c-b584-f399a4eb545c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33662024-12-21T03:03:21.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06190693-cf45-418a-8e7a-cdd0c734344e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33672024-12-21T03:03:21.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06190693-cf45-418a-8e7a-cdd0c734344e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33682024-12-21T03:03:21.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 06190693-cf45-418a-8e7a-cdd0c734344e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
33692024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
33702024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
33712024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33722024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33732024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33742024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
33752024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33762024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
33772024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
33782024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33792024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
33802024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33812024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33822024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
33832024-12-21T03:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33842024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
33852024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
33862024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33872024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
33882024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33892024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33902024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
33912024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33922024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
33932024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33942024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
33952024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
33962024-12-21T03:03:21.839ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33972024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33982024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
33992024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
34002024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34012024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
34022024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34032024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34042024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
34052024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34062024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34072024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34082024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34092024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34102024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34112024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34122024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34132024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34142024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34152024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34162024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34172024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34182024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34192024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34202024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34212024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34222024-12-21T03:03:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34232024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34242024-12-21T03:03:21.842ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34252024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34262024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34272024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34282024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34292024-12-21T03:03:21.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-12-21T03:03:21.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34312024-12-21T03:03:21.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322024-12-21T03:03:21.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-12-21T03:03:21.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-12-21T03:03:21.844ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.326073ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34352024-12-21T03:03:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34362024-12-21T03:03:21.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34372024-12-21T03:03:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34382024-12-21T03:03:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34392024-12-21T03:03:21.845ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34402024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34412024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34422024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34432024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34442024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34452024-12-21T03:03:21.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34462024-12-21T03:03:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34472024-12-21T03:03:21.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34482024-12-21T03:03:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34492024-12-21T03:03:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34502024-12-21T03:03:21.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1847, tv_nsec: 905650276 } })
34512024-12-21T03:03:21.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.182539ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
34522024-12-21T03:03:21.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
34532024-12-21T03:03:21.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1847, tv_nsec: 906527146 } })
34542024-12-21T03:03:21.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
34552024-12-21T03:03:21.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34572024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34582024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34592024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34602024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34612024-12-21T03:03:21.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34622024-12-21T03:03:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34632024-12-21T03:03:21.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34642024-12-21T03:03:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34652024-12-21T03:03:21.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34662024-12-21T03:03:21.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1847, tv_nsec: 912143082 } })
34672024-12-21T03:03:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34682024-12-21T03:03:21.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
34692024-12-21T03:03:21.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-12-21T03:03:21.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-12-21T03:03:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34722024-12-21T03:03:21.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34732024-12-21T03:03:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34742024-12-21T03:03:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
34752024-12-21T03:03:21.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34762024-12-21T03:03:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34772024-12-21T03:03:21.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
34782024-12-21T03:03:21.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.289871ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
34792024-12-21T03:03:21.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34802024-12-21T03:03:21.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34812024-12-21T03:03:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34822024-12-21T03:03:21.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34832024-12-21T03:03:21.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-12-21T03:03:21.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34852024-12-21T03:03:21.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34862024-12-21T03:03:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34872024-12-21T03:03:21.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34882024-12-21T03:03:21.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892024-12-21T03:03:21.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34902024-12-21T03:03:21.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34912024-12-21T03:03:21.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34922024-12-21T03:03:21.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34932024-12-21T03:03:21.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34942024-12-21T03:03:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34952024-12-21T03:03:21.907ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962024-12-21T03:03:21.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34972024-12-21T03:03:21.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.498581ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
34982024-12-21T03:03:21.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34992024-12-21T03:03:21.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35002024-12-21T03:03:21.909ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35012024-12-21T03:03:21.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.020879ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35022024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35032024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35042024-12-21T03:03:21.910ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35052024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35062024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35072024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35082024-12-21T03:03:21.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35092024-12-21T03:03:21.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.992745ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35102024-12-21T03:03:21.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
35112024-12-21T03:03:21.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35122024-12-21T03:03:21.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35132024-12-21T03:03:21.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.989191ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35142024-12-21T03:03:21.917ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.237474ms iteration = 28 status = 0
35152024-12-21T03:03:21.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.058247ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35162024-12-21T03:03:21.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
35172024-12-21T03:03:21.942ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35182024-12-21T03:03:21.942ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70a69542-6e13-48c5-89e2-fc7fcb056d13", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:21 GMT"} })
35192024-12-21T03:03:21.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35202024-12-21T03:03:21.942ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.822533ms iteration = 32 status = {"physical_disks_added":0}
35212024-12-21T03:03:21.943ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
35222024-12-21T03:03:21.943ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35232024-12-21T03:03:21.943ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b931413-e460-4528-b1a9-48c1bb6f3390", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:21 GMT"} })
35242024-12-21T03:03:21.943ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35252024-12-21T03:03:21.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35262024-12-21T03:03:21.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35272024-12-21T03:03:21.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
35282024-12-21T03:03:21.950ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35292024-12-21T03:03:21.951ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d5753d3-ae48-4165-bf3b-4832308becd3", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:21 GMT"} })
35302024-12-21T03:03:21.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35312024-12-21T03:03:21.954ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
35322024-12-21T03:03:21.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35332024-12-21T03:03:21.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35342024-12-21T03:03:21.967ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
35352024-12-21T03:03:21.967ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.934806ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
35362024-12-21T03:03:21.969ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35372024-12-21T03:03:21.969ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35382024-12-21T03:03:21.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.256202ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35392024-12-21T03:03:22.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35402024-12-21T03:03:22.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35412024-12-21T03:03:22.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 162.157125ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35422024-12-21T03:03:22.039ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35432024-12-21T03:03:22.040ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4471a1e5-7b78-4118-91b9-88a6599cd5d5", "content-length": "2", "date": "Sat, 21 Dec 2024 03:03:21 GMT"} })
35442024-12-21T03:03:22.041ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35452024-12-21T03:03:22.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35462024-12-21T03:03:22.049ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.449789ms iteration = 28 status = {}
35472024-12-21T03:03:22.087ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35482024-12-21T03:03:22.087ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35492024-12-21T03:03:22.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c9f2486-1f24-4834-8d89-c2380a93e7ce", "content-length": "372", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
35502024-12-21T03:03:22.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35512024-12-21T03:03:22.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35522024-12-21T03:03:22.089ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.229694ms iteration = 28 status = null
35532024-12-21T03:03:22.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35542024-12-21T03:03:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35552024-12-21T03:03:22.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35562024-12-21T03:03:22.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35572024-12-21T03:03:22.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35582024-12-21T03:03:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35592024-12-21T03:03:22.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-12-21T03:03:22.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35612024-12-21T03:03:22.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35622024-12-21T03:03:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35632024-12-21T03:03:22.128ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35642024-12-21T03:03:22.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35652024-12-21T03:03:22.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c745c40-4e8a-4674-afff-1be912746b38", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
35662024-12-21T03:03:22.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35672024-12-21T03:03:22.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35682024-12-21T03:03:22.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35692024-12-21T03:03:22.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35702024-12-21T03:03:22.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35712024-12-21T03:03:22.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35722024-12-21T03:03:22.227ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35732024-12-21T03:03:22.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c72a2979-22af-4e14-9878-62e5d680523c", "content-length": "691", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
35742024-12-21T03:03:22.227ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35752024-12-21T03:03:22.227ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35762024-12-21T03:03:22.227ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35772024-12-21T03:03:22.228ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.912615ms iteration = 29 status = {}
35782024-12-21T03:03:22.229ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
35792024-12-21T03:03:22.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35802024-12-21T03:03:22.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35812024-12-21T03:03:22.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35822024-12-21T03:03:22.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35832024-12-21T03:03:22.233ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35842024-12-21T03:03:22.233ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35852024-12-21T03:03:22.233ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb3c3b86-9fcc-4694-a004-e52207acd9f2", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
35862024-12-21T03:03:22.235ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 396.071477ms iteration = 30 status = {}
35872024-12-21T03:03:22.238ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35882024-12-21T03:03:22.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "980f61a9-4fc7-4334-9ee4-22e1d458cb49", "content-length": "134", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
35892024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35902024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
35912024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35922024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35932024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35942024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35952024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35962024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35972024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35982024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35992024-12-21T03:03:22.239ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
36002024-12-21T03:03:22.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36012024-12-21T03:03:22.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36022024-12-21T03:03:22.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36032024-12-21T03:03:22.242ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "348dc2a5-d8a3-4d52-b4c5-d000f4a9b31f", "content-length": "2", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
36042024-12-21T03:03:22.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36052024-12-21T03:03:22.242ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b577a20-fdf3-48b4-84fa-7ce9ebd555cf", "content-length": "52", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
36062024-12-21T03:03:22.242ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
36072024-12-21T03:03:22.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36082024-12-21T03:03:22.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a47615a1-aa72-4cb7-90d0-1f4ebe25505a", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
36092024-12-21T03:03:22.339ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
36102024-12-21T03:03:22.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36112024-12-21T03:03:22.343ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d67001d5-cf20-4634-b011-a8899b22bb17", "content-length": "682", "date": "Sat, 21 Dec 2024 03:03:22 GMT"} })
36122024-12-21T03:03:22.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36132024-12-21T03:03:22.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36142024-12-21T03:03:22.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36152024-12-21T03:03:22.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36162024-12-21T03:03:22.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36172024-12-21T03:03:22.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36182024-12-21T03:03:22.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36192024-12-21T03:03:22.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36202024-12-21T03:03:22.359ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 520.867616ms iteration = 28 status = {}
36212024-12-21T03:03:22.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1350891-fb13-48b2-8fe4-66b1e9981024 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36222024-12-21T03:03:22.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1350891-fb13-48b2-8fe4-66b1e9981024 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36232024-12-21T03:03:22.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e1350891-fb13-48b2-8fe4-66b1e9981024 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36242024-12-21T03:03:23.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d415814-e73b-4ada-a753-2db4b5dbc464 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36252024-12-21T03:03:23.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d415814-e73b-4ada-a753-2db4b5dbc464 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36262024-12-21T03:03:23.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0d415814-e73b-4ada-a753-2db4b5dbc464 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36272024-12-21T03:03:24.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1321 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = f83c4b07-0cb9-425d-8ac5-cfad988f4be8 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
36282024-12-21T03:03:24.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a7357b71-b86a-421a-937e-02a207d73c74 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36292024-12-21T03:03:24.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a7357b71-b86a-421a-937e-02a207d73c74 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36302024-12-21T03:03:24.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a7357b71-b86a-421a-937e-02a207d73c74 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36312024-12-21T03:03:25.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 015d67b3-d01c-4bfe-9f04-6446a315bef6 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36322024-12-21T03:03:25.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 015d67b3-d01c-4bfe-9f04-6446a315bef6 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36332024-12-21T03:03:25.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 015d67b3-d01c-4bfe-9f04-6446a315bef6 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36342024-12-21T03:03:26.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7845552d-774d-4f24-ba47-9df8c361733f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36352024-12-21T03:03:26.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7845552d-774d-4f24-ba47-9df8c361733f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36362024-12-21T03:03:26.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7845552d-774d-4f24-ba47-9df8c361733f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36372024-12-21T03:03:27.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ed8d2e8-dfc3-4e84-88c1-f9aa7d91d77d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36382024-12-21T03:03:27.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ed8d2e8-dfc3-4e84-88c1-f9aa7d91d77d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36392024-12-21T03:03:27.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6ed8d2e8-dfc3-4e84-88c1-f9aa7d91d77d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36402024-12-21T03:03:29.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b3eb488c-2935-4b15-a63e-a00296ded26c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36412024-12-21T03:03:29.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b3eb488c-2935-4b15-a63e-a00296ded26c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36422024-12-21T03:03:29.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b3eb488c-2935-4b15-a63e-a00296ded26c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36432024-12-21T03:03:30.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ebc9ec36-38d2-422d-8548-918e3c5027b7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36442024-12-21T03:03:30.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ebc9ec36-38d2-422d-8548-918e3c5027b7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36452024-12-21T03:03:30.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ebc9ec36-38d2-422d-8548-918e3c5027b7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36462024-12-21T03:03:31.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f8701bf-9d4e-4d21-8ed4-6ca75fa6fc76 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36472024-12-21T03:03:31.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f8701bf-9d4e-4d21-8ed4-6ca75fa6fc76 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36482024-12-21T03:03:31.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f8701bf-9d4e-4d21-8ed4-6ca75fa6fc76 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36492024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
36502024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
36512024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36522024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36532024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36542024-12-21T03:03:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36552024-12-21T03:03:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-12-21T03:03:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36572024-12-21T03:03:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36582024-12-21T03:03:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36592024-12-21T03:03:31.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36602024-12-21T03:03:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36612024-12-21T03:03:31.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36622024-12-21T03:03:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36632024-12-21T03:03:31.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.294268ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36642024-12-21T03:03:31.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36652024-12-21T03:03:31.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
36662024-12-21T03:03:31.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36672024-12-21T03:03:31.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36682024-12-21T03:03:31.890ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
36692024-12-21T03:03:31.890ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.325419ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
36702024-12-21T03:03:32.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4692d2c0-ba07-4657-bd53-8f19ced51b62 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36712024-12-21T03:03:32.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4692d2c0-ba07-4657-bd53-8f19ced51b62 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36722024-12-21T03:03:32.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 4692d2c0-ba07-4657-bd53-8f19ced51b62 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36732024-12-21T03:03:33.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b4f31183-562e-42d1-a889-851dc9edc390 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36742024-12-21T03:03:33.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b4f31183-562e-42d1-a889-851dc9edc390 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36752024-12-21T03:03:33.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b4f31183-562e-42d1-a889-851dc9edc390 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36762024-12-21T03:03:34.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1418 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = a459ccb4-f742-4895-9724-4aa9c11f9051 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
36772024-12-21T03:03:34.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7526847d-26de-4b4b-b1b5-1f5d5e01ebdb roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36782024-12-21T03:03:34.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7526847d-26de-4b4b-b1b5-1f5d5e01ebdb resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36792024-12-21T03:03:34.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7526847d-26de-4b4b-b1b5-1f5d5e01ebdb response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36802024-12-21T03:03:34.604ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42035
36812024-12-21T03:03:34.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42035 req_id = 548ae987-1996-4ea5-b70a-e78d6e7774ee roles = RoleSet { roles: {} } uri = /metrics/producers
36822024-12-21T03:03:34.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42035 req_id = 548ae987-1996-4ea5-b70a-e78d6e7774ee resource = Database result = Ok(()) uri = /metrics/producers
36832024-12-21T03:03:34.640ZINFOnexus: assigned collector to new producer collector_id = f33b7779-c528-4a50-88d2-df64a1c51a4f file = nexus/src/app/oximeter.rs:76 producer_id = eb235eaa-a21c-4e67-bc55-d44f49c3daf8
36842024-12-21T03:03:34.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36621 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42035 req_id = 548ae987-1996-4ea5-b70a-e78d6e7774ee response_code = 201 uri = /metrics/producers
36852024-12-21T03:03:35.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53d91405-5af0-4b21-abf2-f6bd5d8f02e4 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36862024-12-21T03:03:35.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53d91405-5af0-4b21-abf2-f6bd5d8f02e4 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36872024-12-21T03:03:35.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 53d91405-5af0-4b21-abf2-f6bd5d8f02e4 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36882024-12-21T03:03:36.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 77dea4b0-dbca-4fd9-b1bc-c1a81c3442d3 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36892024-12-21T03:03:36.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 77dea4b0-dbca-4fd9-b1bc-c1a81c3442d3 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36902024-12-21T03:03:36.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 77dea4b0-dbca-4fd9-b1bc-c1a81c3442d3 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36912024-12-21T03:03:37.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33a6922c-f7ca-49fe-91e5-ce3e2ab588ac roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36922024-12-21T03:03:37.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33a6922c-f7ca-49fe-91e5-ce3e2ab588ac resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36932024-12-21T03:03:37.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 33a6922c-f7ca-49fe-91e5-ce3e2ab588ac response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36942024-12-21T03:03:38.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eff04a09-1837-4094-91ac-0de04099fce5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36952024-12-21T03:03:38.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eff04a09-1837-4094-91ac-0de04099fce5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36962024-12-21T03:03:38.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eff04a09-1837-4094-91ac-0de04099fce5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36972024-12-21T03:03:39.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4ad75e-e710-457c-b0d1-ca1cf2efbf17 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36982024-12-21T03:03:39.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4ad75e-e710-457c-b0d1-ca1cf2efbf17 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
36992024-12-21T03:03:39.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4ad75e-e710-457c-b0d1-ca1cf2efbf17 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37002024-12-21T03:03:40.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7b69f15c-ad5b-4dc2-8fd6-28085574fa2f roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37012024-12-21T03:03:40.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7b69f15c-ad5b-4dc2-8fd6-28085574fa2f resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37022024-12-21T03:03:40.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7b69f15c-ad5b-4dc2-8fd6-28085574fa2f response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37032024-12-21T03:03:41.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 1184d1f0-ea75-48cf-80fe-6903edce8eb5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37042024-12-21T03:03:41.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 1184d1f0-ea75-48cf-80fe-6903edce8eb5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
37052024-12-21T03:03:41.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 1184d1f0-ea75-48cf-80fe-6903edce8eb5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
37062024-12-21T03:03:41.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fb24dbd0-6f34-48ad-b8ae-7ad473a56be6 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37072024-12-21T03:03:41.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fb24dbd0-6f34-48ad-b8ae-7ad473a56be6 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37082024-12-21T03:03:41.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fb24dbd0-6f34-48ad-b8ae-7ad473a56be6 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37092024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
37102024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
37112024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37122024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37132024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37142024-12-21T03:03:41.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37152024-12-21T03:03:41.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37162024-12-21T03:03:41.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37172024-12-21T03:03:41.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37182024-12-21T03:03:41.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.546643ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37192024-12-21T03:03:41.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37202024-12-21T03:03:41.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212024-12-21T03:03:41.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37222024-12-21T03:03:41.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37232024-12-21T03:03:41.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37242024-12-21T03:03:41.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252024-12-21T03:03:41.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
37262024-12-21T03:03:41.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37272024-12-21T03:03:41.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37282024-12-21T03:03:41.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
37292024-12-21T03:03:41.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.605209ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
37302024-12-21T03:03:42.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b897686-47a2-4084-a27c-b257cc3805ab roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37312024-12-21T03:03:42.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b897686-47a2-4084-a27c-b257cc3805ab resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37322024-12-21T03:03:42.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9b897686-47a2-4084-a27c-b257cc3805ab response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37332024-12-21T03:03:43.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a82fc24-8d69-4644-95bc-1f8335d9397b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37342024-12-21T03:03:43.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a82fc24-8d69-4644-95bc-1f8335d9397b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37352024-12-21T03:03:43.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6a82fc24-8d69-4644-95bc-1f8335d9397b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37362024-12-21T03:03:44.038ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = f761a97c-da3c-48a9-8bde-1fa7aaffa8ad response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
37372024-12-21T03:03:44.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a49c796-40a8-4a7e-9863-4f7fca0eca4b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37382024-12-21T03:03:44.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a49c796-40a8-4a7e-9863-4f7fca0eca4b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37392024-12-21T03:03:44.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9a49c796-40a8-4a7e-9863-4f7fca0eca4b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37402024-12-21T03:03:45.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4cece1-6693-40cc-ace8-3d94c742a891 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37412024-12-21T03:03:45.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4cece1-6693-40cc-ace8-3d94c742a891 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37422024-12-21T03:03:45.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = cd4cece1-6693-40cc-ace8-3d94c742a891 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37432024-12-21T03:03:46.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c87953e-bb11-4528-ba7d-1854fd6dc3fd roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37442024-12-21T03:03:46.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c87953e-bb11-4528-ba7d-1854fd6dc3fd resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37452024-12-21T03:03:46.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c87953e-bb11-4528-ba7d-1854fd6dc3fd response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37462024-12-21T03:03:47.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f68f174b-bce4-46b4-8d4e-23e2460dea45 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37472024-12-21T03:03:47.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f68f174b-bce4-46b4-8d4e-23e2460dea45 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37482024-12-21T03:03:47.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f68f174b-bce4-46b4-8d4e-23e2460dea45 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37492024-12-21T03:03:48.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7bf81c-652d-4e5f-bb2a-2995fdc2a014 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37502024-12-21T03:03:48.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7bf81c-652d-4e5f-bb2a-2995fdc2a014 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37512024-12-21T03:03:48.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 5f7bf81c-652d-4e5f-bb2a-2995fdc2a014 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37522024-12-21T03:03:49.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fba0d529-9fbb-4389-b727-018c82130b21 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37532024-12-21T03:03:49.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fba0d529-9fbb-4389-b727-018c82130b21 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37542024-12-21T03:03:49.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = fba0d529-9fbb-4389-b727-018c82130b21 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37552024-12-21T03:03:50.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 84a71325-ba01-4f00-95be-08ca5dd9695b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37562024-12-21T03:03:50.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 84a71325-ba01-4f00-95be-08ca5dd9695b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37572024-12-21T03:03:50.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 84a71325-ba01-4f00-95be-08ca5dd9695b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37582024-12-21T03:03:51.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41fd2bda-1fd5-49b9-9bbf-56e461784cac roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37592024-12-21T03:03:51.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41fd2bda-1fd5-49b9-9bbf-56e461784cac resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37602024-12-21T03:03:51.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 41fd2bda-1fd5-49b9-9bbf-56e461784cac response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
37612024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
37622024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
37632024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37642024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37652024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37662024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
37672024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
37682024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37692024-12-21T03:03:51.839ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 02:53:51.839113933 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
37702024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
37712024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
37722024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
37732024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
37742024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37752024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
37762024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
37772024-12-21T03:03:51.839ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = aa6a1816-1ed4-446b-8121-599a04d2c280
37782024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
37792024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.411\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280"}
37802024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
37812024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
37822024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
37832024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37842024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37852024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
37862024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
37872024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
37882024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37902024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
37912024-12-21T03:03:51.839ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37922024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
37932024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37942024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37952024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37962024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
37972024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37982024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
37992024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38002024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
38012024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38022024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
38032024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38042024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
38052024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38062024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
38072024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
38082024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38092024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38102024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
38112024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38122024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
38132024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38142024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38152024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
38162024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
38172024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38182024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
38192024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
38202024-12-21T03:03:51.839ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38212024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38222024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
38232024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38242024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
38252024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38262024-12-21T03:03:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38272024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38282024-12-21T03:03:51.840ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4bf02835-271c-4b1b-a7ae-b005eed1920c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da604828-d4f1-4898-b180-39aa8632768d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fb98f734-c99a-4ecb-bba3-508a9b86a289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1877, tv_nsec: 896484049 } })
38292024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38302024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38312024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38322024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38332024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38342024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38352024-12-21T03:03:51.840ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d789b63-e234-471f-abd5-426e10c5c6e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("82a0d97c-0396-4dff-a562-7bc3f12f4b4d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1877, tv_nsec: 896649121 } })
38362024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38372024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38382024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38392024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38402024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38412024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38422024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38432024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38442024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38452024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38462024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38472024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38482024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38492024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38502024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38512024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38522024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
38532024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.71476ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
38542024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
38552024-12-21T03:03:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.72363ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
38562024-12-21T03:03:51.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38572024-12-21T03:03:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.478121ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38582024-12-21T03:03:51.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38592024-12-21T03:03:51.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38602024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38612024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38622024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38632024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38642024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38652024-12-21T03:03:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38662024-12-21T03:03:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38672024-12-21T03:03:51.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38682024-12-21T03:03:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38692024-12-21T03:03:51.847ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 02:53:51.839113933 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38702024-12-21T03:03:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.133495ms iteration = 15 status = {"expiration":"2024-12-21T02:53:51.839113933Z","pruned":[]}
38712024-12-21T03:03:51.849ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.124178ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
38722024-12-21T03:03:51.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38732024-12-21T03:03:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38742024-12-21T03:03:51.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-12-21T03:03:51.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1877, tv_nsec: 907857742 } })
38762024-12-21T03:03:51.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
38772024-12-21T03:03:51.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38782024-12-21T03:03:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38792024-12-21T03:03:51.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38802024-12-21T03:03:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38812024-12-21T03:03:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38822024-12-21T03:03:51.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38832024-12-21T03:03:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38842024-12-21T03:03:51.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38852024-12-21T03:03:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38862024-12-21T03:03:51.857ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38872024-12-21T03:03:51.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38882024-12-21T03:03:51.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38892024-12-21T03:03:51.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38902024-12-21T03:03:51.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1877, tv_nsec: 916035267 } })
38912024-12-21T03:03:51.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
38922024-12-21T03:03:51.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38932024-12-21T03:03:51.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1877, tv_nsec: 919590459 } })
38942024-12-21T03:03:51.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38952024-12-21T03:03:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38962024-12-21T03:03:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38972024-12-21T03:03:51.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
38982024-12-21T03:03:51.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38992024-12-21T03:03:51.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39002024-12-21T03:03:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39012024-12-21T03:03:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39022024-12-21T03:03:51.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032024-12-21T03:03:51.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39042024-12-21T03:03:51.887ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39052024-12-21T03:03:51.887ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39062024-12-21T03:03:51.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39072024-12-21T03:03:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39082024-12-21T03:03:51.888ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39092024-12-21T03:03:51.888ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39102024-12-21T03:03:51.888ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.535299ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39112024-12-21T03:03:51.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39122024-12-21T03:03:51.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132024-12-21T03:03:51.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.452517ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
39142024-12-21T03:03:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39152024-12-21T03:03:51.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39162024-12-21T03:03:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39172024-12-21T03:03:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
39182024-12-21T03:03:51.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39192024-12-21T03:03:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39202024-12-21T03:03:51.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39212024-12-21T03:03:51.901ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39222024-12-21T03:03:51.901ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39232024-12-21T03:03:51.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39242024-12-21T03:03:51.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39252024-12-21T03:03:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39262024-12-21T03:03:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39272024-12-21T03:03:51.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39282024-12-21T03:03:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39292024-12-21T03:03:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39302024-12-21T03:03:51.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39312024-12-21T03:03:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39322024-12-21T03:03:51.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39332024-12-21T03:03:51.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39342024-12-21T03:03:51.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-12-21T03:03:51.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39362024-12-21T03:03:51.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39372024-12-21T03:03:51.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39382024-12-21T03:03:51.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-12-21T03:03:51.920ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39402024-12-21T03:03:51.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39412024-12-21T03:03:51.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39422024-12-21T03:03:51.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39432024-12-21T03:03:51.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39442024-12-21T03:03:51.923ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39452024-12-21T03:03:51.923ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39462024-12-21T03:03:51.923ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.370176ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39472024-12-21T03:03:51.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39482024-12-21T03:03:51.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39492024-12-21T03:03:51.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 90.794281ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
39502024-12-21T03:03:51.931ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39512024-12-21T03:03:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39522024-12-21T03:03:51.933ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39532024-12-21T03:03:51.933ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39542024-12-21T03:03:51.933ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39552024-12-21T03:03:51.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39562024-12-21T03:03:51.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39572024-12-21T03:03:51.935ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39582024-12-21T03:03:51.935ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39592024-12-21T03:03:51.935ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.307606ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39602024-12-21T03:03:51.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612024-12-21T03:03:51.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-12-21T03:03:51.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.046369ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39632024-12-21T03:03:51.940ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39642024-12-21T03:03:51.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.614085ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39652024-12-21T03:03:51.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39662024-12-21T03:03:51.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39672024-12-21T03:03:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39682024-12-21T03:03:51.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39692024-12-21T03:03:51.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39702024-12-21T03:03:51.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712024-12-21T03:03:51.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39722024-12-21T03:03:51.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
39732024-12-21T03:03:51.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39742024-12-21T03:03:51.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.554339ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
39752024-12-21T03:03:51.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762024-12-21T03:03:51.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
39772024-12-21T03:03:51.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39782024-12-21T03:03:51.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39792024-12-21T03:03:51.957ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.853007ms iteration = 29 status = 0
39802024-12-21T03:03:51.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39812024-12-21T03:03:51.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39822024-12-21T03:03:51.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39832024-12-21T03:03:51.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39842024-12-21T03:03:51.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 144.506849ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39852024-12-21T03:03:51.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-12-21T03:03:51.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39872024-12-21T03:03:51.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39882024-12-21T03:03:51.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39892024-12-21T03:03:51.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 153.131489ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39902024-12-21T03:03:51.993ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39912024-12-21T03:03:51.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39922024-12-21T03:03:52.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39932024-12-21T03:03:52.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39942024-12-21T03:03:52.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39952024-12-21T03:03:52.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39962024-12-21T03:03:52.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39972024-12-21T03:03:52.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39982024-12-21T03:03:52.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39992024-12-21T03:03:52.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40002024-12-21T03:03:52.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40012024-12-21T03:03:52.047ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
40022024-12-21T03:03:52.047ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40032024-12-21T03:03:52.047ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f138311-db60-48f3-a276-d697dfa11917", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40042024-12-21T03:03:52.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40052024-12-21T03:03:52.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40062024-12-21T03:03:52.059ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.361715ms iteration = 33 status = {"physical_disks_added":0}
40072024-12-21T03:03:52.091ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40082024-12-21T03:03:52.091ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40092024-12-21T03:03:52.092ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1176b281-5d67-44da-8d64-aee8d5ec1630", "content-length": "372", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40102024-12-21T03:03:52.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40112024-12-21T03:03:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40122024-12-21T03:03:52.094ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40132024-12-21T03:03:52.094ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40142024-12-21T03:03:52.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40152024-12-21T03:03:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40162024-12-21T03:03:52.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-12-21T03:03:52.097ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40182024-12-21T03:03:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40192024-12-21T03:03:52.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40202024-12-21T03:03:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40212024-12-21T03:03:52.104ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40222024-12-21T03:03:52.105ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3283978a-f4f3-4886-9e4d-5a859edf66c7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
40232024-12-21T03:03:52.105ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40242024-12-21T03:03:52.105ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 02:49:52.719690 UTC dns_group = internal generation = 1
40252024-12-21T03:03:52.105ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 265.898017ms iteration = 16 status = {"generation":1}
40262024-12-21T03:03:52.128ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40272024-12-21T03:03:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40282024-12-21T03:03:52.131ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40292024-12-21T03:03:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40302024-12-21T03:03:52.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 294.44317ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40312024-12-21T03:03:52.134ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
40322024-12-21T03:03:52.134ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40332024-12-21T03:03:52.134ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9a87ddd-7e40-4068-8ced-bbd219e233b8", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40342024-12-21T03:03:52.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40352024-12-21T03:03:52.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-12-21T03:03:52.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40372024-12-21T03:03:52.137ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
40382024-12-21T03:03:52.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40392024-12-21T03:03:52.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40402024-12-21T03:03:52.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40412024-12-21T03:03:52.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40422024-12-21T03:03:52.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40432024-12-21T03:03:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40442024-12-21T03:03:52.158ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
40452024-12-21T03:03:52.158ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40462024-12-21T03:03:52.158ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fdd48db-79d2-44ff-936b-cf3f23dcb82c", "content-length": "26", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40472024-12-21T03:03:52.158ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40482024-12-21T03:03:52.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40492024-12-21T03:03:52.164ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40502024-12-21T03:03:52.164ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40512024-12-21T03:03:52.164ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "05020cd5-af13-423e-b065-600a05357bce", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40522024-12-21T03:03:52.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40532024-12-21T03:03:52.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40542024-12-21T03:03:52.166ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
40552024-12-21T03:03:52.166ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 326.557785ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40562024-12-21T03:03:52.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40572024-12-21T03:03:52.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40582024-12-21T03:03:52.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40592024-12-21T03:03:52.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40602024-12-21T03:03:52.173ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40612024-12-21T03:03:52.173ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 333.938481ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40622024-12-21T03:03:52.175ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T02:49:48.310639Z, time_modified: 2024-12-21T02:49:48.310639Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, db_silo: Silo { identity: SiloIdentity { id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T02:49:54.511215Z, time_modified: 2024-12-21T02:49:54.511215Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220" }] }) }
40632024-12-21T03:03:52.175ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 336.33651ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]}},"default_endpoint":{"silo_id":"871537f7-f2d9-43ea-807b-39a8eba23cc8","tls_certs":["c39a1e70bdfd4b48da45b3c5e660fc8122fd5025e296abe3d516d6b806c11220"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40642024-12-21T03:03:52.177ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40652024-12-21T03:03:52.177ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 0 version = 2
40662024-12-21T03:03:52.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40672024-12-21T03:03:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40682024-12-21T03:03:52.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692024-12-21T03:03:52.178ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40702024-12-21T03:03:52.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40712024-12-21T03:03:52.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e59774ff-bc90-48d1-b308-0a7b7362e7bb", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40722024-12-21T03:03:52.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.174526ms iteration = 31 status = {}
40732024-12-21T03:03:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40742024-12-21T03:03:52.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40752024-12-21T03:03:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40762024-12-21T03:03:52.183ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 027d52e0-37f7-4ad9-ad81-4419c2b99789 dns_zone_name = oxide.test found_so_far = 1 version = 2
40772024-12-21T03:03:52.183ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40782024-12-21T03:03:52.183ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 02:49:54.573469 UTC dns_group = external generation = 2
40792024-12-21T03:03:52.183ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 344.373584ms iteration = 16 status = {"generation":2}
40802024-12-21T03:03:52.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40812024-12-21T03:03:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40822024-12-21T03:03:52.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40832024-12-21T03:03:52.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40842024-12-21T03:03:52.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40852024-12-21T03:03:52.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40862024-12-21T03:03:52.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-12-21T03:03:52.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40882024-12-21T03:03:52.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40892024-12-21T03:03:52.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40902024-12-21T03:03:52.251ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40912024-12-21T03:03:52.252ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "68895164-52f4-4834-998c-3153719ac98c", "content-length": "2", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
40922024-12-21T03:03:52.257ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40932024-12-21T03:03:52.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40942024-12-21T03:03:52.260ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 420.867207ms iteration = 29 status = null
40952024-12-21T03:03:52.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40962024-12-21T03:03:52.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40972024-12-21T03:03:52.269ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7f679d36-6966-4f46-a4ec-fd48af2316e5", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40982024-12-21T03:03:52.269ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40992024-12-21T03:03:52.271ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9837e09f-9be5-415b-b5e1-78e12aa8ccd9", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41002024-12-21T03:03:52.271ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41012024-12-21T03:03:52.272ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41022024-12-21T03:03:52.272ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 433.160741ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41032024-12-21T03:03:52.273ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 434.418375ms iteration = 29 status = {}
41042024-12-21T03:03:52.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41052024-12-21T03:03:52.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "79773a73-5df5-4dce-bc08-d48c616835ec", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41062024-12-21T03:03:52.308ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41072024-12-21T03:03:52.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "70ddbbc2-7544-4b6b-9883-724a8f297743", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41082024-12-21T03:03:52.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41092024-12-21T03:03:52.311ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4266b93e-37b9-4c84-9d03-b1a7c9f50473", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41102024-12-21T03:03:52.311ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41112024-12-21T03:03:52.313ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41122024-12-21T03:03:52.313ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 473.757195ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41132024-12-21T03:03:52.370ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41142024-12-21T03:03:52.370ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac1333f-0cb7-48a1-a75a-5be40304485e", "content-length": "691", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41152024-12-21T03:03:52.370ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41162024-12-21T03:03:52.370ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41172024-12-21T03:03:52.370ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41182024-12-21T03:03:52.372ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 533.626815ms iteration = 30 status = {}
41192024-12-21T03:03:52.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41202024-12-21T03:03:52.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41212024-12-21T03:03:52.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
41222024-12-21T03:03:52.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41232024-12-21T03:03:52.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41242024-12-21T03:03:52.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41252024-12-21T03:03:52.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f37496e8-bd69-4947-954f-77c531155654", "content-length": "134", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41262024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41272024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
41282024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41292024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41302024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41312024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41322024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41332024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41342024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41352024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41362024-12-21T03:03:52.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
41372024-12-21T03:03:52.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41382024-12-21T03:03:52.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41392024-12-21T03:03:52.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41402024-12-21T03:03:52.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef39686-2b3d-48df-af45-9c0993c5a90d", "content-length": "2", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41412024-12-21T03:03:52.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41422024-12-21T03:03:52.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb71d583-1e8b-4ff4-a8a7-2a3a94790435", "content-length": "52", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41432024-12-21T03:03:52.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
41442024-12-21T03:03:52.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41452024-12-21T03:03:52.559ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9fcb3e78-be71-4972-b84b-8ae490ae3b66", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41462024-12-21T03:03:52.559ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
41472024-12-21T03:03:52.559ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41482024-12-21T03:03:52.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f776ebef-7a2c-41be-860e-e43bde55cd26 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41492024-12-21T03:03:52.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f776ebef-7a2c-41be-860e-e43bde55cd26 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41502024-12-21T03:03:52.560ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "deedb973-4601-40c0-abf6-c7709f13e9cf", "content-length": "682", "date": "Sat, 21 Dec 2024 03:03:52 GMT"} })
41512024-12-21T03:03:52.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41522024-12-21T03:03:52.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41532024-12-21T03:03:52.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f776ebef-7a2c-41be-860e-e43bde55cd26 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41542024-12-21T03:03:52.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41552024-12-21T03:03:52.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41562024-12-21T03:03:52.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41572024-12-21T03:03:52.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41582024-12-21T03:03:52.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41592024-12-21T03:03:52.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41602024-12-21T03:03:52.580ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.407442ms iteration = 29 status = {}
41612024-12-21T03:03:53.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b707c462-2664-475c-8cdb-1f64518fca52 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41622024-12-21T03:03:53.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b707c462-2664-475c-8cdb-1f64518fca52 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41632024-12-21T03:03:53.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b707c462-2664-475c-8cdb-1f64518fca52 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41642024-12-21T03:03:54.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1345 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 68984b52-51d1-47e4-8ed0-caba3f84316f response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
41652024-12-21T03:03:54.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d204439c-c17a-4b2d-b1e4-6a3ca8b58e37 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41662024-12-21T03:03:54.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d204439c-c17a-4b2d-b1e4-6a3ca8b58e37 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41672024-12-21T03:03:54.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = d204439c-c17a-4b2d-b1e4-6a3ca8b58e37 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41682024-12-21T03:03:55.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb1eda10-8e9c-46d5-9fa1-744c72364d04 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41692024-12-21T03:03:55.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb1eda10-8e9c-46d5-9fa1-744c72364d04 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41702024-12-21T03:03:55.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eb1eda10-8e9c-46d5-9fa1-744c72364d04 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41712024-12-21T03:03:56.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85d9841e-c182-4d8a-af3b-c3868df94718 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41722024-12-21T03:03:56.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85d9841e-c182-4d8a-af3b-c3868df94718 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41732024-12-21T03:03:56.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 85d9841e-c182-4d8a-af3b-c3868df94718 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41742024-12-21T03:03:57.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17defb73-457b-4daa-b96a-6583b7b84240 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41752024-12-21T03:03:57.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17defb73-457b-4daa-b96a-6583b7b84240 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41762024-12-21T03:03:57.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 17defb73-457b-4daa-b96a-6583b7b84240 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41772024-12-21T03:03:58.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 436dd661-fe5b-41cd-8518-5a00207758ed roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41782024-12-21T03:03:58.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 436dd661-fe5b-41cd-8518-5a00207758ed resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41792024-12-21T03:03:58.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 436dd661-fe5b-41cd-8518-5a00207758ed response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41802024-12-21T03:03:59.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09fdd2f-b44e-4481-a5b9-8a866c3b267b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41812024-12-21T03:03:59.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09fdd2f-b44e-4481-a5b9-8a866c3b267b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41822024-12-21T03:03:59.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a09fdd2f-b44e-4481-a5b9-8a866c3b267b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41832024-12-21T03:04:00.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6dd3fb62-2413-436d-8b0f-74fbdbf569a4 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41842024-12-21T03:04:00.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6dd3fb62-2413-436d-8b0f-74fbdbf569a4 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41852024-12-21T03:04:00.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6dd3fb62-2413-436d-8b0f-74fbdbf569a4 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41862024-12-21T03:04:01.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 068c357e-2575-4684-890a-723b800fa128 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41872024-12-21T03:04:01.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 068c357e-2575-4684-890a-723b800fa128 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41882024-12-21T03:04:01.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 068c357e-2575-4684-890a-723b800fa128 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
41892024-12-21T03:04:01.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
41902024-12-21T03:04:01.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
41912024-12-21T03:04:01.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41922024-12-21T03:04:01.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41932024-12-21T03:04:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41942024-12-21T03:04:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41952024-12-21T03:04:01.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-12-21T03:04:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41972024-12-21T03:04:01.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-12-21T03:04:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41992024-12-21T03:04:01.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42002024-12-21T03:04:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42012024-12-21T03:04:01.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42022024-12-21T03:04:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42032024-12-21T03:04:01.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42042024-12-21T03:04:01.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
42052024-12-21T03:04:01.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42062024-12-21T03:04:01.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42072024-12-21T03:04:01.885ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
42082024-12-21T03:04:01.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.299321ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
42092024-12-21T03:04:01.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.480743ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42102024-12-21T03:04:02.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 313022ea-dd8e-461f-b321-d850e3ff2ed8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42112024-12-21T03:04:02.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 313022ea-dd8e-461f-b321-d850e3ff2ed8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42122024-12-21T03:04:02.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 313022ea-dd8e-461f-b321-d850e3ff2ed8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42132024-12-21T03:04:03.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ba6d5bf-65fa-45ff-821d-f8b63b8520da roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42142024-12-21T03:04:03.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ba6d5bf-65fa-45ff-821d-f8b63b8520da resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42152024-12-21T03:04:03.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8ba6d5bf-65fa-45ff-821d-f8b63b8520da response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42162024-12-21T03:04:04.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 47ce6d9c-5e9b-45c1-a97f-412f9d37160d roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42172024-12-21T03:04:04.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 47ce6d9c-5e9b-45c1-a97f-412f9d37160d resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42182024-12-21T03:04:04.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 47ce6d9c-5e9b-45c1-a97f-412f9d37160d response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42192024-12-21T03:04:04.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 0d8529ce-b507-48f7-9c0e-24eadfd78146 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42202024-12-21T03:04:04.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 0d8529ce-b507-48f7-9c0e-24eadfd78146 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42212024-12-21T03:04:04.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 0d8529ce-b507-48f7-9c0e-24eadfd78146 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42222024-12-21T03:04:04.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 843ce1df-86a4-4703-8da1-84f936e99378 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
42232024-12-21T03:04:04.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 16a72288-b032-4618-a1a6-f573ac29e3ac roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42242024-12-21T03:04:04.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 16a72288-b032-4618-a1a6-f573ac29e3ac resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42252024-12-21T03:04:04.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 16a72288-b032-4618-a1a6-f573ac29e3ac response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42262024-12-21T03:04:05.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f168ddc-0bbe-4a73-836e-5b7edc1958e7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42272024-12-21T03:04:05.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f168ddc-0bbe-4a73-836e-5b7edc1958e7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42282024-12-21T03:04:05.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 3f168ddc-0bbe-4a73-836e-5b7edc1958e7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42292024-12-21T03:04:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 29c44943-f42e-4b73-9c13-db41349da2ef roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42302024-12-21T03:04:06.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 29c44943-f42e-4b73-9c13-db41349da2ef resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42312024-12-21T03:04:06.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 29c44943-f42e-4b73-9c13-db41349da2ef response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42322024-12-21T03:04:07.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4e048fc-62e9-45a0-a1c3-1852472ca440 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42332024-12-21T03:04:07.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4e048fc-62e9-45a0-a1c3-1852472ca440 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42342024-12-21T03:04:07.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4e048fc-62e9-45a0-a1c3-1852472ca440 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42352024-12-21T03:04:08.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 90b48602-2b90-4606-a5b7-04de45c00531 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42362024-12-21T03:04:08.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 90b48602-2b90-4606-a5b7-04de45c00531 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42372024-12-21T03:04:08.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 90b48602-2b90-4606-a5b7-04de45c00531 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42382024-12-21T03:04:09.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6bc8361f-860d-438e-b684-6668fe8caebc roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42392024-12-21T03:04:09.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6bc8361f-860d-438e-b684-6668fe8caebc resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42402024-12-21T03:04:09.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 6bc8361f-860d-438e-b684-6668fe8caebc response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42412024-12-21T03:04:10.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4aa48a5-475b-4ab1-812e-26f9c5d86c00 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42422024-12-21T03:04:10.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4aa48a5-475b-4ab1-812e-26f9c5d86c00 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42432024-12-21T03:04:10.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f4aa48a5-475b-4ab1-812e-26f9c5d86c00 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42442024-12-21T03:04:11.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 803a80bc-82c9-4dab-9378-392168f4a5cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
42452024-12-21T03:04:11.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 803a80bc-82c9-4dab-9378-392168f4a5cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
42462024-12-21T03:04:11.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = 803a80bc-82c9-4dab-9378-392168f4a5cb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
42472024-12-21T03:04:11.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
42482024-12-21T03:04:11.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42492024-12-21T03:04:11.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
42502024-12-21T03:04:11.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512024-12-21T03:04:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42522024-12-21T03:04:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42532024-12-21T03:04:11.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42542024-12-21T03:04:11.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42552024-12-21T03:04:11.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42562024-12-21T03:04:11.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42572024-12-21T03:04:11.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42582024-12-21T03:04:11.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42592024-12-21T03:04:11.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42602024-12-21T03:04:11.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
42612024-12-21T03:04:11.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42622024-12-21T03:04:11.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42632024-12-21T03:04:11.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
42642024-12-21T03:04:11.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.011286ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
42652024-12-21T03:04:11.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42662024-12-21T03:04:11.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42672024-12-21T03:04:11.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.91425ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42682024-12-21T03:04:11.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e81e1450-6fae-4d4b-8536-da052acdbfa5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42692024-12-21T03:04:11.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e81e1450-6fae-4d4b-8536-da052acdbfa5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42702024-12-21T03:04:11.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = e81e1450-6fae-4d4b-8536-da052acdbfa5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42712024-12-21T03:04:13.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9521a0ba-c247-42f5-b662-06c123233f8a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42722024-12-21T03:04:13.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9521a0ba-c247-42f5-b662-06c123233f8a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42732024-12-21T03:04:13.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 9521a0ba-c247-42f5-b662-06c123233f8a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42742024-12-21T03:04:14.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c7d7c0f-9951-473f-90a5-1b0417afce65 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42752024-12-21T03:04:14.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c7d7c0f-9951-473f-90a5-1b0417afce65 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42762024-12-21T03:04:14.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 8c7d7c0f-9951-473f-90a5-1b0417afce65 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42772024-12-21T03:04:14.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1364 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 07e163b0-d473-4811-8b1f-2d98fd2c0838 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
42782024-12-21T03:04:15.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 02dc4e69-301e-4543-ab3d-9d9124f5d29e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42792024-12-21T03:04:15.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 02dc4e69-301e-4543-ab3d-9d9124f5d29e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42802024-12-21T03:04:15.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 02dc4e69-301e-4543-ab3d-9d9124f5d29e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42812024-12-21T03:04:16.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ac97367b-09e2-455a-8db0-20b182bd446a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42822024-12-21T03:04:16.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ac97367b-09e2-455a-8db0-20b182bd446a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42832024-12-21T03:04:16.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ac97367b-09e2-455a-8db0-20b182bd446a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42842024-12-21T03:04:17.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9edd3df-f207-43d1-88c8-981b39415114 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42852024-12-21T03:04:17.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9edd3df-f207-43d1-88c8-981b39415114 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42862024-12-21T03:04:17.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a9edd3df-f207-43d1-88c8-981b39415114 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42872024-12-21T03:04:18.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 333bb5c0-5cca-473d-a351-e16132362f20 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42882024-12-21T03:04:18.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 333bb5c0-5cca-473d-a351-e16132362f20 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42892024-12-21T03:04:18.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 333bb5c0-5cca-473d-a351-e16132362f20 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42902024-12-21T03:04:19.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 12144173-6334-4aad-8d8f-7521d21882ac roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42912024-12-21T03:04:19.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 12144173-6334-4aad-8d8f-7521d21882ac resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42922024-12-21T03:04:19.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = 12144173-6334-4aad-8d8f-7521d21882ac response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?sort_by=id_ascending
42932024-12-21T03:04:19.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = ec36eda7-fa43-4a4c-b2f3-6d26c4753d35 roles = RoleSet { roles: {} } uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42942024-12-21T03:04:19.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = ec36eda7-fa43-4a4c-b2f3-6d26c4753d35 resource = Database result = Ok(()) uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42952024-12-21T03:04:19.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41548 req_id = ec36eda7-fa43-4a4c-b2f3-6d26c4753d35 response_code = 200 uri = /metrics/collectors/f33b7779-c528-4a50-88d2-df64a1c51a4f/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjIzNWVhYS1hMjFjLTRlNjctYmM1NS1kNDRmNDljM2RhZjgifX0%3D
42962024-12-21T03:04:19.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 026eb6a9-f5a0-4f35-83c2-dc60812926a7 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42972024-12-21T03:04:19.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 026eb6a9-f5a0-4f35-83c2-dc60812926a7 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42982024-12-21T03:04:19.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 026eb6a9-f5a0-4f35-83c2-dc60812926a7 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
42992024-12-21T03:04:20.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec066bad-cd95-4335-b0c5-315b19dbb663 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43002024-12-21T03:04:20.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec066bad-cd95-4335-b0c5-315b19dbb663 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43012024-12-21T03:04:20.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec066bad-cd95-4335-b0c5-315b19dbb663 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43022024-12-21T03:04:21.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0048a6a5-5086-4ced-8995-9c2b0c60b1b9 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43032024-12-21T03:04:21.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0048a6a5-5086-4ced-8995-9c2b0c60b1b9 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43042024-12-21T03:04:21.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 0048a6a5-5086-4ced-8995-9c2b0c60b1b9 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
43052024-12-21T03:04:21.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
43062024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43072024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
43082024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43092024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
43102024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
43112024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43122024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43132024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
43142024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43152024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
43162024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43172024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
43182024-12-21T03:04:21.840ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43192024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
43202024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43212024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43222024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
43232024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43242024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
43252024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43262024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
43272024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43282024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
43292024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43302024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
43312024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43322024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43332024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
43342024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43352024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
43362024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43372024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
43382024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43392024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
43402024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
43412024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43422024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43432024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43442024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43452024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43462024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43472024-12-21T03:04:21.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43482024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43492024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43502024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43512024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43522024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43532024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43542024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43552024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43562024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43572024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43582024-12-21T03:04:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43592024-12-21T03:04:21.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43602024-12-21T03:04:21.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43612024-12-21T03:04:21.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43622024-12-21T03:04:21.844ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.429082ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43632024-12-21T03:04:21.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-12-21T03:04:21.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43652024-12-21T03:04:21.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43662024-12-21T03:04:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43672024-12-21T03:04:21.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43682024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43692024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43702024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43712024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43722024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43732024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43742024-12-21T03:04:21.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43752024-12-21T03:04:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43762024-12-21T03:04:21.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43772024-12-21T03:04:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43782024-12-21T03:04:21.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792024-12-21T03:04:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43802024-12-21T03:04:21.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43812024-12-21T03:04:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43822024-12-21T03:04:21.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1907, tv_nsec: 910439152 } })
43832024-12-21T03:04:21.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.461509ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
43842024-12-21T03:04:21.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
43852024-12-21T03:04:21.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1907, tv_nsec: 911111759 } })
43862024-12-21T03:04:21.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
43872024-12-21T03:04:21.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43882024-12-21T03:04:21.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43892024-12-21T03:04:21.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43902024-12-21T03:04:21.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43912024-12-21T03:04:21.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-74b11855-33fc-4fcf-8c0e-d7e8e9d5e531.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1907, tv_nsec: 912930571 } })
43922024-12-21T03:04:21.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43932024-12-21T03:04:21.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
43942024-12-21T03:04:21.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-12-21T03:04:21.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43962024-12-21T03:04:21.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43972024-12-21T03:04:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43982024-12-21T03:04:21.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
43992024-12-21T03:04:21.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44002024-12-21T03:04:21.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44012024-12-21T03:04:21.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44022024-12-21T03:04:21.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.485993ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44032024-12-21T03:04:21.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-12-21T03:04:21.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44052024-12-21T03:04:21.880ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44062024-12-21T03:04:21.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44072024-12-21T03:04:21.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44082024-12-21T03:04:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44092024-12-21T03:04:21.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
44102024-12-21T03:04:21.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.849649ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
44112024-12-21T03:04:21.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44122024-12-21T03:04:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44132024-12-21T03:04:21.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44142024-12-21T03:04:21.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44152024-12-21T03:04:21.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44162024-12-21T03:04:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44172024-12-21T03:04:21.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.095669ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
44182024-12-21T03:04:21.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44192024-12-21T03:04:21.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44202024-12-21T03:04:21.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44212024-12-21T03:04:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44222024-12-21T03:04:21.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44232024-12-21T03:04:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44242024-12-21T03:04:21.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44252024-12-21T03:04:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44262024-12-21T03:04:21.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.127753ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44272024-12-21T03:04:21.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44282024-12-21T03:04:21.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44292024-12-21T03:04:21.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44302024-12-21T03:04:21.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44312024-12-21T03:04:21.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44322024-12-21T03:04:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44332024-12-21T03:04:21.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342024-12-21T03:04:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44352024-12-21T03:04:21.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44362024-12-21T03:04:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44372024-12-21T03:04:21.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44382024-12-21T03:04:21.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44392024-12-21T03:04:21.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.43598ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44402024-12-21T03:04:21.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44412024-12-21T03:04:21.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44422024-12-21T03:04:21.948ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44432024-12-21T03:04:21.948ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44442024-12-21T03:04:21.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44452024-12-21T03:04:21.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44462024-12-21T03:04:21.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.424498ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44472024-12-21T03:04:21.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.86045ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44482024-12-21T03:04:21.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
44492024-12-21T03:04:21.967ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44502024-12-21T03:04:21.967ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34ee4138-59c6-48fa-819f-4444b2bd50d0", "content-length": "26", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
44512024-12-21T03:04:21.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44522024-12-21T03:04:21.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-12-21T03:04:21.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44542024-12-21T03:04:21.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531, lookup_type: ById(74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) } result = Ok(())
44552024-12-21T03:04:21.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44562024-12-21T03:04:21.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44572024-12-21T03:04:21.974ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.43592ms iteration = 30 status = 0
44582024-12-21T03:04:21.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-12-21T03:04:21.975ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
44602024-12-21T03:04:21.975ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44612024-12-21T03:04:21.976ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b2ad562-c9f6-46d9-9be4-ff711d511e2d", "content-length": "26", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
44622024-12-21T03:04:21.976ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44632024-12-21T03:04:21.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44642024-12-21T03:04:21.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44652024-12-21T03:04:21.978ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44662024-12-21T03:04:21.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44672024-12-21T03:04:21.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 zone_address = fd00:1122:3344:101::2
44682024-12-21T03:04:21.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44692024-12-21T03:04:21.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6e13739-9c2b-4348-888f-85ffadcc3efc", "content-length": "26", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
44702024-12-21T03:04:21.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44712024-12-21T03:04:21.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
44722024-12-21T03:04:21.988ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44732024-12-21T03:04:21.988ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44742024-12-21T03:04:21.988ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.706677ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44752024-12-21T03:04:22.019ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
44762024-12-21T03:04:22.019ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 179.103143ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
44772024-12-21T03:04:22.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44782024-12-21T03:04:22.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44792024-12-21T03:04:22.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802024-12-21T03:04:22.055ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.109294ms iteration = 34 status = {"physical_disks_added":0}
44812024-12-21T03:04:22.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44822024-12-21T03:04:22.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44832024-12-21T03:04:22.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44842024-12-21T03:04:22.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44852024-12-21T03:04:22.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44862024-12-21T03:04:22.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44872024-12-21T03:04:22.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44882024-12-21T03:04:22.086ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44892024-12-21T03:04:22.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44902024-12-21T03:04:22.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "638a151f-29f7-4e68-84c2-ce30d537565b", "content-length": "372", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
44912024-12-21T03:04:22.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44922024-12-21T03:04:22.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44932024-12-21T03:04:22.093ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 253.30716ms iteration = 30 status = {}
44942024-12-21T03:04:22.100ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44952024-12-21T03:04:22.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44962024-12-21T03:04:22.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "368802f3-6768-47a4-8d70-d15ac95671ba", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
44972024-12-21T03:04:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44982024-12-21T03:04:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44992024-12-21T03:04:22.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45002024-12-21T03:04:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45012024-12-21T03:04:22.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45022024-12-21T03:04:22.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45032024-12-21T03:04:22.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45042024-12-21T03:04:22.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b4e30e-181e-4974-952d-a05ebd83f7ed", "content-length": "691", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
45052024-12-21T03:04:22.173ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45062024-12-21T03:04:22.173ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45072024-12-21T03:04:22.173ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45082024-12-21T03:04:22.174ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 334.796802ms iteration = 31 status = {}
45092024-12-21T03:04:22.176ZINFOnexus (BackgroundTasks): VPC route manager sled 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45102024-12-21T03:04:22.176ZDEBGnexus (BackgroundTasks): client request SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45112024-12-21T03:04:22.176ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45122024-12-21T03:04:22.177ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e672040-5318-45ca-868f-80e5080a390b", "content-length": "2", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
45132024-12-21T03:04:22.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "970763a1-6534-413b-8ba9-3d5f1afa94ca", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
45142024-12-21T03:04:22.179ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45152024-12-21T03:04:22.179ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 339.430626ms iteration = 32 status = {}
45162024-12-21T03:04:22.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45172024-12-21T03:04:22.181ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.823692ms iteration = 30 status = null
45182024-12-21T03:04:22.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1774be01-cd27-4947-b8a7-f019eb1c2e0e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45192024-12-21T03:04:22.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1774be01-cd27-4947-b8a7-f019eb1c2e0e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45202024-12-21T03:04:22.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1774be01-cd27-4947-b8a7-f019eb1c2e0e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45212024-12-21T03:04:22.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45222024-12-21T03:04:22.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45232024-12-21T03:04:22.247ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1f0cbf5d-bb18-4772-a66a-905e36241f5e, rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(7ae77e81-1442-471c-98a4-8ef73fe5b813) } rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
45242024-12-21T03:04:22.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45252024-12-21T03:04:22.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45262024-12-21T03:04:22.256ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45272024-12-21T03:04:22.256ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "83136c35-68df-43a2-96a8-2de3d4bde6e6", "content-length": "134", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
45282024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45292024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 7ae77e81-1442-471c-98a4-8ef73fe5b813
45302024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45312024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45322024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45332024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45342024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45352024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45362024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45372024-12-21T03:04:22.256ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45382024-12-21T03:04:22.257ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5
45392024-12-21T03:04:22.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45402024-12-21T03:04:22.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45412024-12-21T03:04:22.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45422024-12-21T03:04:22.259ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "831a6561-9d2e-4f20-bb8b-6e5da01d2757", "content-length": "2", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
45432024-12-21T03:04:22.259ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45442024-12-21T03:04:22.259ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "486f4154-0017-4aed-b804-12af8424dde1", "content-length": "52", "date": "Sat, 21 Dec 2024 03:04:21 GMT"} })
45452024-12-21T03:04:22.259ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch_location = Switch0
45462024-12-21T03:04:22.259ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45472024-12-21T03:04:22.444ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e41719f9-fe3f-4959-b1e0-e82e6a1e9fe6", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
45482024-12-21T03:04:22.444ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 switch = Switch0
45492024-12-21T03:04:22.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45502024-12-21T03:04:22.444ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e82f3ce5-f4b3-438e-a750-485ef194a2d5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3887d90b-c9e1-4e56-b0ff-87ff0cffbeb1", "content-length": "682", "date": "Sat, 21 Dec 2024 03:04:22 GMT"} })
45512024-12-21T03:04:22.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45522024-12-21T03:04:22.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45532024-12-21T03:04:22.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45542024-12-21T03:04:22.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45552024-12-21T03:04:22.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45562024-12-21T03:04:22.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45572024-12-21T03:04:22.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45582024-12-21T03:04:22.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45592024-12-21T03:04:22.466ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.166145ms iteration = 30 status = {}
45602024-12-21T03:04:23.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c078b8ad-a83d-49d8-8559-321307c25176 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45612024-12-21T03:04:23.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c078b8ad-a83d-49d8-8559-321307c25176 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45622024-12-21T03:04:23.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = c078b8ad-a83d-49d8-8559-321307c25176 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45632024-12-21T03:04:24.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1268 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = f3100882-308d-4f18-a969-84f19ab32e70 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
45642024-12-21T03:04:24.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7bf9dbe4-e87c-49ff-ad0b-5eb969dc621d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45652024-12-21T03:04:24.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7bf9dbe4-e87c-49ff-ad0b-5eb969dc621d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45662024-12-21T03:04:24.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 7bf9dbe4-e87c-49ff-ad0b-5eb969dc621d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45672024-12-21T03:04:25.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f220de61-54f0-4646-8f41-d72b05a537ed roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45682024-12-21T03:04:25.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f220de61-54f0-4646-8f41-d72b05a537ed resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45692024-12-21T03:04:25.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f220de61-54f0-4646-8f41-d72b05a537ed response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45702024-12-21T03:04:26.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 300e59be-d2ef-466d-a1f1-32f5f9eba400 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45712024-12-21T03:04:26.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 300e59be-d2ef-466d-a1f1-32f5f9eba400 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45722024-12-21T03:04:26.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 300e59be-d2ef-466d-a1f1-32f5f9eba400 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45732024-12-21T03:04:27.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = da48a79e-d3f4-41af-8279-64e35bb9ceea roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45742024-12-21T03:04:27.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = da48a79e-d3f4-41af-8279-64e35bb9ceea resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45752024-12-21T03:04:27.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = da48a79e-d3f4-41af-8279-64e35bb9ceea response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45762024-12-21T03:04:28.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 14e420b5-fe0a-4647-93ba-2471e7156205 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45772024-12-21T03:04:28.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 14e420b5-fe0a-4647-93ba-2471e7156205 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45782024-12-21T03:04:28.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 14e420b5-fe0a-4647-93ba-2471e7156205 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45792024-12-21T03:04:29.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f87aabad-56aa-4d45-b984-f03e01206bf8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45802024-12-21T03:04:29.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f87aabad-56aa-4d45-b984-f03e01206bf8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45812024-12-21T03:04:29.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = f87aabad-56aa-4d45-b984-f03e01206bf8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45822024-12-21T03:04:30.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4a51b71-836d-4984-b3e6-080503c09cdf roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45832024-12-21T03:04:30.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4a51b71-836d-4984-b3e6-080503c09cdf resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45842024-12-21T03:04:30.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a4a51b71-836d-4984-b3e6-080503c09cdf response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45852024-12-21T03:04:31.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 99afc477-a586-4a00-938a-52bd68c3709c roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45862024-12-21T03:04:31.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 99afc477-a586-4a00-938a-52bd68c3709c resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45872024-12-21T03:04:31.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 99afc477-a586-4a00-938a-52bd68c3709c response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
45882024-12-21T03:04:31.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
45892024-12-21T03:04:31.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
45902024-12-21T03:04:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45912024-12-21T03:04:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45922024-12-21T03:04:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45932024-12-21T03:04:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45942024-12-21T03:04:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45952024-12-21T03:04:31.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45962024-12-21T03:04:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45972024-12-21T03:04:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.372321ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45982024-12-21T03:04:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45992024-12-21T03:04:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46002024-12-21T03:04:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46012024-12-21T03:04:31.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46022024-12-21T03:04:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46032024-12-21T03:04:31.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042024-12-21T03:04:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
46052024-12-21T03:04:31.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46062024-12-21T03:04:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46072024-12-21T03:04:31.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
46082024-12-21T03:04:31.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.683575ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
46092024-12-21T03:04:32.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b8bbf0e1-8125-4ba2-91fe-ebd24d372d15 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46102024-12-21T03:04:32.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b8bbf0e1-8125-4ba2-91fe-ebd24d372d15 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46112024-12-21T03:04:32.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b8bbf0e1-8125-4ba2-91fe-ebd24d372d15 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46122024-12-21T03:04:33.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b6921325-ff7c-4281-9641-4a1ee8c82ff5 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46132024-12-21T03:04:33.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b6921325-ff7c-4281-9641-4a1ee8c82ff5 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46142024-12-21T03:04:33.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b6921325-ff7c-4281-9641-4a1ee8c82ff5 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46152024-12-21T03:04:34.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1273 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 023e00e2-cc03-4bfa-9fcf-d61818e5c0e1 response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
46162024-12-21T03:04:34.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec506b14-717a-4794-bc3e-c2df995c8e0e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46172024-12-21T03:04:34.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec506b14-717a-4794-bc3e-c2df995c8e0e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46182024-12-21T03:04:34.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = ec506b14-717a-4794-bc3e-c2df995c8e0e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46192024-12-21T03:04:35.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eaa97d12-3c18-4720-9370-67f0c1651da0 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46202024-12-21T03:04:35.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eaa97d12-3c18-4720-9370-67f0c1651da0 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46212024-12-21T03:04:35.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = eaa97d12-3c18-4720-9370-67f0c1651da0 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46222024-12-21T03:04:36.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 57241531-e669-48f4-9d42-69602ec32872 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46232024-12-21T03:04:36.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 57241531-e669-48f4-9d42-69602ec32872 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46242024-12-21T03:04:36.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 57241531-e669-48f4-9d42-69602ec32872 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46252024-12-21T03:04:37.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 50e14002-f868-42e4-8b3e-652c765e4b38 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46262024-12-21T03:04:37.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 50e14002-f868-42e4-8b3e-652c765e4b38 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46272024-12-21T03:04:37.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 50e14002-f868-42e4-8b3e-652c765e4b38 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46282024-12-21T03:04:38.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = dceb4dcb-a173-448d-a9f3-bdaa11c266f8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46292024-12-21T03:04:38.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = dceb4dcb-a173-448d-a9f3-bdaa11c266f8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46302024-12-21T03:04:38.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = dceb4dcb-a173-448d-a9f3-bdaa11c266f8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46312024-12-21T03:04:39.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 49900950-2799-43eb-98fc-45b5831e73e8 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46322024-12-21T03:04:39.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 49900950-2799-43eb-98fc-45b5831e73e8 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46332024-12-21T03:04:39.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 49900950-2799-43eb-98fc-45b5831e73e8 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46342024-12-21T03:04:40.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1d8bbec1-4100-4464-b702-476f0985f00d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46352024-12-21T03:04:40.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1d8bbec1-4100-4464-b702-476f0985f00d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46362024-12-21T03:04:40.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 1d8bbec1-4100-4464-b702-476f0985f00d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46372024-12-21T03:04:41.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = d4f83def-5480-440b-8c6b-b1808d2ac457 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
46382024-12-21T03:04:41.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = d4f83def-5480-440b-8c6b-b1808d2ac457 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
46392024-12-21T03:04:41.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42735 req_id = d4f83def-5480-440b-8c6b-b1808d2ac457 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
46402024-12-21T03:04:41.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b68f62bf-b2c8-434f-96c9-a1d88d312c6e roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46412024-12-21T03:04:41.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b68f62bf-b2c8-434f-96c9-a1d88d312c6e resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46422024-12-21T03:04:41.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b68f62bf-b2c8-434f-96c9-a1d88d312c6e response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46432024-12-21T03:04:41.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
46442024-12-21T03:04:41.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46452024-12-21T03:04:41.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
46462024-12-21T03:04:41.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46472024-12-21T03:04:41.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46482024-12-21T03:04:41.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46492024-12-21T03:04:41.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46502024-12-21T03:04:41.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46512024-12-21T03:04:41.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46522024-12-21T03:04:41.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.656905ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46532024-12-21T03:04:41.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46542024-12-21T03:04:41.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46552024-12-21T03:04:41.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46562024-12-21T03:04:41.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46572024-12-21T03:04:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46582024-12-21T03:04:41.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46592024-12-21T03:04:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: aa6a1816-1ed4-446b-8121-599a04d2c280, lookup_type: ById(aa6a1816-1ed4-446b-8121-599a04d2c280) } result = Ok(())
46602024-12-21T03:04:41.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46612024-12-21T03:04:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46622024-12-21T03:04:41.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 original_time_created = 2024-12-21 02:49:45.651870 UTC target_id = aa6a1816-1ed4-446b-8121-599a04d2c280 time_created = 2024-12-21 02:49:45.651870 UTC
46632024-12-21T03:04:41.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.231279ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"aa6a1816-1ed4-446b-8121-599a04d2c280","time_created":"2024-12-21T02:49:45.651870Z"}
46642024-12-21T03:04:42.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 19d55a8a-9156-485c-a9e1-ef14611df01b roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46652024-12-21T03:04:42.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 19d55a8a-9156-485c-a9e1-ef14611df01b resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46662024-12-21T03:04:42.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 19d55a8a-9156-485c-a9e1-ef14611df01b response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46672024-12-21T03:04:43.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91b9144e-badb-4df4-8012-303c7ec47b81 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46682024-12-21T03:04:43.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91b9144e-badb-4df4-8012-303c7ec47b81 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46692024-12-21T03:04:43.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 91b9144e-badb-4df4-8012-303c7ec47b81 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46702024-12-21T03:04:44.039ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1329 local_addr = [fd00:1122:3344:101::c]:62534 method = GET remote_addr = [fd00:1122:3344:101::d]:59077 req_id = 304a13bd-0dd5-45f0-9546-4a0727a804db response_code = 200 uri = /4f50fa81-5371-4a88-a8b4-4e3726e451a5
46712024-12-21T03:04:44.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b98ea5aa-351d-4c23-aa61-5bf25a9dd1ad roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46722024-12-21T03:04:44.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b98ea5aa-351d-4c23-aa61-5bf25a9dd1ad resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46732024-12-21T03:04:44.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = b98ea5aa-351d-4c23-aa61-5bf25a9dd1ad response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46742024-12-21T03:04:45.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 380af8ae-e6ce-4f22-aaae-ddf0cc1b266d roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46752024-12-21T03:04:45.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 380af8ae-e6ce-4f22-aaae-ddf0cc1b266d resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46762024-12-21T03:04:45.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 380af8ae-e6ce-4f22-aaae-ddf0cc1b266d response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46772024-12-21T03:04:46.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a970a9d0-c4b7-4bce-af6e-3ab6d935f229 roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46782024-12-21T03:04:46.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a970a9d0-c4b7-4bce-af6e-3ab6d935f229 resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46792024-12-21T03:04:46.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = a970a9d0-c4b7-4bce-af6e-3ab6d935f229 response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46802024-12-21T03:04:47.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 036cf9aa-a6c1-4aa6-84da-52fde68d1b3a roles = RoleSet { roles: {} } uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46812024-12-21T03:04:47.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 036cf9aa-a6c1-4aa6-84da-52fde68d1b3a resource = Database result = Ok(()) uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
46822024-12-21T03:04:47.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40850 req_id = 036cf9aa-a6c1-4aa6-84da-52fde68d1b3a response_code = 200 uri = /probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531