Max level shown:
12024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
22024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
52024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62024-08-28T23:30:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72024-08-28T23:30:02.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82024-08-28T23:30:02.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92024-08-28T23:30:02.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102024-08-28T23:30:02.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112024-08-28T23:30:02.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122024-08-28T23:30:02.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132024-08-28T23:30:02.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142024-08-28T23:30:02.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
152024-08-28T23:30:02.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-08-28T23:30:02.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-08-28T23:30:02.112ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
182024-08-28T23:30:02.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.192286ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
192024-08-28T23:30:02.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202024-08-28T23:30:02.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
212024-08-28T23:30:02.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.050666ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
222024-08-28T23:30:02.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd79d3ca-aafd-4fe3-aa06-6aff8915cecf roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
232024-08-28T23:30:02.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd79d3ca-aafd-4fe3-aa06-6aff8915cecf resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
242024-08-28T23:30:02.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd79d3ca-aafd-4fe3-aa06-6aff8915cecf response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
252024-08-28T23:30:02.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1015 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = fe96b222-72b8-46ae-90f4-db9134aef902 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
262024-08-28T23:30:03.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7ffd8776-c409-411e-9372-49f89970d1a6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
272024-08-28T23:30:03.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7ffd8776-c409-411e-9372-49f89970d1a6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
282024-08-28T23:30:03.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7ffd8776-c409-411e-9372-49f89970d1a6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
292024-08-28T23:30:04.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de600294-20d8-4295-9c93-b2ee9ab0a9e6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
302024-08-28T23:30:04.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de600294-20d8-4295-9c93-b2ee9ab0a9e6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
312024-08-28T23:30:04.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de600294-20d8-4295-9c93-b2ee9ab0a9e6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
322024-08-28T23:30:05.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 671be9ef-b172-4c42-a2a7-9bc4b6d709de roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
332024-08-28T23:30:05.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 671be9ef-b172-4c42-a2a7-9bc4b6d709de resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
342024-08-28T23:30:05.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 671be9ef-b172-4c42-a2a7-9bc4b6d709de response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
352024-08-28T23:30:06.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 126145d9-010c-40a4-99e4-4679109e45b2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
362024-08-28T23:30:06.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 126145d9-010c-40a4-99e4-4679109e45b2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
372024-08-28T23:30:06.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 126145d9-010c-40a4-99e4-4679109e45b2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
382024-08-28T23:30:07.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 082efba2-5fc4-4e2d-a8f0-6dd61242abf1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
392024-08-28T23:30:07.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 082efba2-5fc4-4e2d-a8f0-6dd61242abf1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
402024-08-28T23:30:07.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 082efba2-5fc4-4e2d-a8f0-6dd61242abf1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
412024-08-28T23:30:08.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c972f43-f258-4328-9684-da4b7010297b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
422024-08-28T23:30:08.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c972f43-f258-4328-9684-da4b7010297b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
432024-08-28T23:30:08.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c972f43-f258-4328-9684-da4b7010297b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
442024-08-28T23:30:09.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ed3259-b824-4034-b185-9d8a5274ee3e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
452024-08-28T23:30:09.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ed3259-b824-4034-b185-9d8a5274ee3e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
462024-08-28T23:30:09.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ed3259-b824-4034-b185-9d8a5274ee3e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
472024-08-28T23:30:10.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18bf7cc1-3fc8-45c1-85d5-a309ba615a20 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
482024-08-28T23:30:10.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18bf7cc1-3fc8-45c1-85d5-a309ba615a20 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
492024-08-28T23:30:10.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18bf7cc1-3fc8-45c1-85d5-a309ba615a20 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
502024-08-28T23:30:11.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8b821e3-6b66-4bbc-8244-1004ac4ff045 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
512024-08-28T23:30:11.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8b821e3-6b66-4bbc-8244-1004ac4ff045 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
522024-08-28T23:30:11.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8b821e3-6b66-4bbc-8244-1004ac4ff045 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
532024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
542024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
552024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
562024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
572024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
582024-08-28T23:30:12.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
592024-08-28T23:30:12.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
602024-08-28T23:30:12.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
612024-08-28T23:30:12.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
622024-08-28T23:30:12.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632024-08-28T23:30:12.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
642024-08-28T23:30:12.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
652024-08-28T23:30:12.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
662024-08-28T23:30:12.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
672024-08-28T23:30:12.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
682024-08-28T23:30:12.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
692024-08-28T23:30:12.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
702024-08-28T23:30:12.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.823765ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
712024-08-28T23:30:12.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
722024-08-28T23:30:12.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
732024-08-28T23:30:12.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.917053ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
742024-08-28T23:30:12.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2b35813-ad0f-4bff-a8de-78e2863ec4f8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
752024-08-28T23:30:12.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2b35813-ad0f-4bff-a8de-78e2863ec4f8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
762024-08-28T23:30:12.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2b35813-ad0f-4bff-a8de-78e2863ec4f8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
772024-08-28T23:30:12.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 390 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 2ac4243a-eead-474b-9ee0-e40193ff46dc response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
782024-08-28T23:30:13.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b4c5e07-0e05-45d7-8f9f-9bd2e9285388 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
792024-08-28T23:30:13.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b4c5e07-0e05-45d7-8f9f-9bd2e9285388 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
802024-08-28T23:30:13.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b4c5e07-0e05-45d7-8f9f-9bd2e9285388 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
812024-08-28T23:30:14.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7b0be09-c164-4d8f-a713-2bfbd8fdc697 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
822024-08-28T23:30:14.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7b0be09-c164-4d8f-a713-2bfbd8fdc697 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
832024-08-28T23:30:14.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7b0be09-c164-4d8f-a713-2bfbd8fdc697 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
842024-08-28T23:30:15.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8823fd46-75ae-470d-ad7e-9578bb5426a3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
852024-08-28T23:30:15.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8823fd46-75ae-470d-ad7e-9578bb5426a3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
862024-08-28T23:30:15.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8823fd46-75ae-470d-ad7e-9578bb5426a3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
872024-08-28T23:30:16.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 798fd57e-a53d-4769-99dc-10e1a41d7574 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
882024-08-28T23:30:16.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 798fd57e-a53d-4769-99dc-10e1a41d7574 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
892024-08-28T23:30:16.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 798fd57e-a53d-4769-99dc-10e1a41d7574 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
902024-08-28T23:30:17.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 57e316ce-9c46-450a-b9e0-23cc307ae5b3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
912024-08-28T23:30:17.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 57e316ce-9c46-450a-b9e0-23cc307ae5b3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
922024-08-28T23:30:17.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 57e316ce-9c46-450a-b9e0-23cc307ae5b3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
932024-08-28T23:30:18.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1b38866b-9c8a-4f86-bd43-5afbf5795047 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
942024-08-28T23:30:18.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1b38866b-9c8a-4f86-bd43-5afbf5795047 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
952024-08-28T23:30:18.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1b38866b-9c8a-4f86-bd43-5afbf5795047 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
962024-08-28T23:30:19.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f01ca9d8-b673-42ae-b713-c485a0f0850a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
972024-08-28T23:30:19.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f01ca9d8-b673-42ae-b713-c485a0f0850a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
982024-08-28T23:30:19.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f01ca9d8-b673-42ae-b713-c485a0f0850a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
992024-08-28T23:30:20.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 538a088a-eb36-4321-9e93-d1f28ba4106c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1002024-08-28T23:30:20.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 538a088a-eb36-4321-9e93-d1f28ba4106c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1012024-08-28T23:30:20.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 538a088a-eb36-4321-9e93-d1f28ba4106c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1022024-08-28T23:30:22.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cdb669e4-02c9-4e54-9f3c-a61339bdb61a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1032024-08-28T23:30:22.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cdb669e4-02c9-4e54-9f3c-a61339bdb61a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1042024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
1052024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
1062024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1072024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
1082024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
1092024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
1102024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1112024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1122024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1132024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
1142024-08-28T23:30:22.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
1152024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1162024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
1172024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1182024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
1192024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
1202024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1212024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
1222024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1232024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1242024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
1252024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1262024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
1272024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1282024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
1292024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1302024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
1312024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
1322024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1332024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
1342024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1352024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1362024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1372024-08-28T23:30:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1382024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1392024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1402024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1412024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1422024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1432024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1442024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1452024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1462024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1472024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1482024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1492024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1502024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1512024-08-28T23:30:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1522024-08-28T23:30:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1170, tv_nsec: 876089160 } })
1532024-08-28T23:30:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1170, tv_nsec: 876128721 } })
1542024-08-28T23:30:22.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
1552024-08-28T23:30:22.096ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.842299ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1562024-08-28T23:30:22.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1572024-08-28T23:30:22.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
1582024-08-28T23:30:22.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-08-28T23:30:22.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1602024-08-28T23:30:22.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1612024-08-28T23:30:22.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1622024-08-28T23:30:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1632024-08-28T23:30:22.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1642024-08-28T23:30:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1652024-08-28T23:30:22.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1662024-08-28T23:30:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1672024-08-28T23:30:22.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1682024-08-28T23:30:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1692024-08-28T23:30:22.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1702024-08-28T23:30:22.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1170, tv_nsec: 888413645 } })
1712024-08-28T23:30:22.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1722024-08-28T23:30:22.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1732024-08-28T23:30:22.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1742024-08-28T23:30:22.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
1752024-08-28T23:30:22.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762024-08-28T23:30:22.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cdb669e4-02c9-4e54-9f3c-a61339bdb61a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
1772024-08-28T23:30:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782024-08-28T23:30:22.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-08-28T23:30:22.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
1802024-08-28T23:30:22.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1812024-08-28T23:30:22.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1822024-08-28T23:30:22.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
1832024-08-28T23:30:22.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.605537ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
1842024-08-28T23:30:22.130ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1852024-08-28T23:30:22.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1862024-08-28T23:30:22.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.848343ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
1872024-08-28T23:30:22.134ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1882024-08-28T23:30:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1892024-08-28T23:30:22.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902024-08-28T23:30:22.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912024-08-28T23:30:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1922024-08-28T23:30:22.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1932024-08-28T23:30:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1942024-08-28T23:30:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1952024-08-28T23:30:22.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1962024-08-28T23:30:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1972024-08-28T23:30:22.141ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1982024-08-28T23:30:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1992024-08-28T23:30:22.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2002024-08-28T23:30:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2012024-08-28T23:30:22.143ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2022024-08-28T23:30:22.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2032024-08-28T23:30:22.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2042024-08-28T23:30:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2052024-08-28T23:30:22.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2062024-08-28T23:30:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2072024-08-28T23:30:22.148ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
2082024-08-28T23:30:22.148ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2092024-08-28T23:30:22.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2102024-08-28T23:30:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2112024-08-28T23:30:22.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2122024-08-28T23:30:22.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2132024-08-28T23:30:22.154ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
2142024-08-28T23:30:22.154ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2152024-08-28T23:30:22.154ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc81cbec-ab26-4c7e-9f61-2f1af019bb05", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2162024-08-28T23:30:22.154ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2172024-08-28T23:30:22.155ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2182024-08-28T23:30:22.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192024-08-28T23:30:22.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
2202024-08-28T23:30:22.159ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2212024-08-28T23:30:22.161ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c01b59c0-e375-42aa-bdea-8a2708f49c68", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2222024-08-28T23:30:22.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2232024-08-28T23:30:22.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2242024-08-28T23:30:22.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2252024-08-28T23:30:22.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2262024-08-28T23:30:22.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.299499ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2272024-08-28T23:30:22.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2282024-08-28T23:30:22.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2292024-08-28T23:30:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2302024-08-28T23:30:22.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
2312024-08-28T23:30:22.181ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2322024-08-28T23:30:22.181ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90412c31-7e4f-456d-bfeb-8b5a1f15eb73", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2332024-08-28T23:30:22.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2342024-08-28T23:30:22.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
2352024-08-28T23:30:22.184ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2362024-08-28T23:30:22.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.901773ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2372024-08-28T23:30:22.184ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.124317ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
2382024-08-28T23:30:22.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.343771ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2392024-08-28T23:30:22.187ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
2402024-08-28T23:30:22.187ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2412024-08-28T23:30:22.187ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.781654ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
2422024-08-28T23:30:22.213ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
2432024-08-28T23:30:22.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.932971ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2442024-08-28T23:30:22.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2452024-08-28T23:30:22.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2462024-08-28T23:30:22.244ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2472024-08-28T23:30:22.244ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c57663b-9a40-44fd-b2ac-5d92ac8613b2", "content-length": "1", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2482024-08-28T23:30:22.246ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2492024-08-28T23:30:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2502024-08-28T23:30:22.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2512024-08-28T23:30:22.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2522024-08-28T23:30:22.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2532024-08-28T23:30:22.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2542024-08-28T23:30:22.280ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.528735ms iteration = 8 status = {"physical_disks_added":0}
2552024-08-28T23:30:22.335ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2562024-08-28T23:30:22.338ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.697744ms iteration = 6 status = null
2572024-08-28T23:30:22.338ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2582024-08-28T23:30:22.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592024-08-28T23:30:22.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2602024-08-28T23:30:22.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2612024-08-28T23:30:22.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2622024-08-28T23:30:22.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2632024-08-28T23:30:22.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2642024-08-28T23:30:22.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652024-08-28T23:30:22.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
2662024-08-28T23:30:22.343ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2672024-08-28T23:30:22.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2682024-08-28T23:30:22.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2692024-08-28T23:30:22.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2702024-08-28T23:30:22.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2712024-08-28T23:30:22.345ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 253.936156ms iteration = 6 status = 0
2722024-08-28T23:30:22.358ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 266.884492ms iteration = 6 status = {}
2732024-08-28T23:30:22.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2742024-08-28T23:30:22.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aad1a0a2-4207-4906-b89f-2b02b7ff9130", "content-length": "691", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2752024-08-28T23:30:22.440ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2762024-08-28T23:30:22.440ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2772024-08-28T23:30:22.440ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2782024-08-28T23:30:22.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "003995be-f829-4ac3-99f7-83d3dd26ef3b", "content-length": "372", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2792024-08-28T23:30:22.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2802024-08-28T23:30:22.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2812024-08-28T23:30:22.441ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.073738ms iteration = 6 status = {}
2822024-08-28T23:30:22.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2832024-08-28T23:30:22.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2842024-08-28T23:30:22.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2852024-08-28T23:30:22.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2862024-08-28T23:30:22.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2872024-08-28T23:30:22.450ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ced1d606-f75c-42c4-a648-63c0b46133e5", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2882024-08-28T23:30:22.451ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.941087ms iteration = 6 status = {}
2892024-08-28T23:30:22.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2902024-08-28T23:30:22.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2912024-08-28T23:30:22.464ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
2922024-08-28T23:30:22.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2932024-08-28T23:30:22.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2942024-08-28T23:30:22.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2952024-08-28T23:30:22.470ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7281fec1-ca34-45bb-b695-9e2944b051a9", "content-length": "121", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
2962024-08-28T23:30:22.470ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2972024-08-28T23:30:22.470ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
2982024-08-28T23:30:22.471ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2992024-08-28T23:30:22.471ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3002024-08-28T23:30:22.471ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
3012024-08-28T23:30:22.471ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
3022024-08-28T23:30:22.471ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
3032024-08-28T23:30:22.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3042024-08-28T23:30:22.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3052024-08-28T23:30:22.472ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3062024-08-28T23:30:22.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1c28327b-a941-4ff9-b6b6-b8ecbfd7d4ec", "content-length": "2", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
3072024-08-28T23:30:22.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3082024-08-28T23:30:22.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83bb98f4-82e0-4de7-a7eb-bd891222e588", "content-length": "52", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
3092024-08-28T23:30:22.473ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
3102024-08-28T23:30:22.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3112024-08-28T23:30:22.571ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f1fbcd63-3fee-49f0-bcbd-7511fd3926f7", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
3122024-08-28T23:30:22.571ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
3132024-08-28T23:30:22.571ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3142024-08-28T23:30:22.571ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e79e07-33b1-4ac1-8482-f48f9446c294", "content-length": "667", "date": "Wed, 28 Aug 2024 23:30:22 GMT"} })
3152024-08-28T23:30:22.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3162024-08-28T23:30:22.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3172024-08-28T23:30:22.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3182024-08-28T23:30:22.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3192024-08-28T23:30:22.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3202024-08-28T23:30:22.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3212024-08-28T23:30:22.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3222024-08-28T23:30:22.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3232024-08-28T23:30:22.587ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.268252ms iteration = 6 status = {}
3242024-08-28T23:30:22.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 407 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 2dfc5d72-4e70-4438-bc77-1721ac039802 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
3252024-08-28T23:30:23.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2349ab34-dd95-4d61-8944-cdd7b047ee95 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3262024-08-28T23:30:23.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2349ab34-dd95-4d61-8944-cdd7b047ee95 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3272024-08-28T23:30:23.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2349ab34-dd95-4d61-8944-cdd7b047ee95 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3282024-08-28T23:30:24.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3a9d3411-69af-4871-95b4-b0551be0fa2c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3292024-08-28T23:30:24.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3a9d3411-69af-4871-95b4-b0551be0fa2c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3302024-08-28T23:30:24.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3a9d3411-69af-4871-95b4-b0551be0fa2c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3312024-08-28T23:30:25.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84246a0f-2fb7-4e5b-9a5c-d098e819b6f4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3322024-08-28T23:30:25.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84246a0f-2fb7-4e5b-9a5c-d098e819b6f4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3332024-08-28T23:30:25.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84246a0f-2fb7-4e5b-9a5c-d098e819b6f4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3342024-08-28T23:30:26.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9b24e80e-735f-4af0-a5bc-9d55748d3c3b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3352024-08-28T23:30:26.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9b24e80e-735f-4af0-a5bc-9d55748d3c3b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3362024-08-28T23:30:26.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9b24e80e-735f-4af0-a5bc-9d55748d3c3b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3372024-08-28T23:30:27.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2e10a3fd-47ba-40e1-94dd-39a3dcb8ed73 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3382024-08-28T23:30:27.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2e10a3fd-47ba-40e1-94dd-39a3dcb8ed73 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3392024-08-28T23:30:27.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2e10a3fd-47ba-40e1-94dd-39a3dcb8ed73 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3402024-08-28T23:30:28.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63490714-e586-4ba2-8717-f3249a27cb99 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3412024-08-28T23:30:28.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63490714-e586-4ba2-8717-f3249a27cb99 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3422024-08-28T23:30:28.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63490714-e586-4ba2-8717-f3249a27cb99 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3432024-08-28T23:30:29.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198a63a2-153e-4963-861b-777a7ec84b09 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3442024-08-28T23:30:29.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198a63a2-153e-4963-861b-777a7ec84b09 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3452024-08-28T23:30:29.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198a63a2-153e-4963-861b-777a7ec84b09 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3462024-08-28T23:30:30.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4572bc65-fe55-4abf-a167-60b2e36c8849 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3472024-08-28T23:30:30.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4572bc65-fe55-4abf-a167-60b2e36c8849 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3482024-08-28T23:30:30.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4572bc65-fe55-4abf-a167-60b2e36c8849 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3492024-08-28T23:30:31.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 247a17e1-2848-452e-a446-ddbcac6d3353 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3502024-08-28T23:30:31.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 247a17e1-2848-452e-a446-ddbcac6d3353 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3512024-08-28T23:30:31.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 247a17e1-2848-452e-a446-ddbcac6d3353 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3522024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
3532024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3542024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3552024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
3562024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3572024-08-28T23:30:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3582024-08-28T23:30:32.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592024-08-28T23:30:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3602024-08-28T23:30:32.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3612024-08-28T23:30:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3622024-08-28T23:30:32.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3632024-08-28T23:30:32.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3642024-08-28T23:30:32.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3652024-08-28T23:30:32.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
3662024-08-28T23:30:32.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3672024-08-28T23:30:32.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3682024-08-28T23:30:32.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3692024-08-28T23:30:32.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3702024-08-28T23:30:32.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
3712024-08-28T23:30:32.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.865443ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
3722024-08-28T23:30:32.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.221586ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3732024-08-28T23:30:32.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65547993-ac46-44de-9c49-f9fd0a512f92 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3742024-08-28T23:30:32.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65547993-ac46-44de-9c49-f9fd0a512f92 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3752024-08-28T23:30:32.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65547993-ac46-44de-9c49-f9fd0a512f92 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3762024-08-28T23:30:32.722ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 454 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = ba1a34e4-bcd4-4509-bc00-f0f441f081a0 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
3772024-08-28T23:30:33.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3c6f3557-5642-442c-be17-480a929cc47c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3782024-08-28T23:30:33.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3c6f3557-5642-442c-be17-480a929cc47c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3792024-08-28T23:30:33.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3c6f3557-5642-442c-be17-480a929cc47c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3802024-08-28T23:30:34.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 801b9276-312c-44c8-a749-619ce9174fde roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3812024-08-28T23:30:34.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 801b9276-312c-44c8-a749-619ce9174fde resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3822024-08-28T23:30:34.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 801b9276-312c-44c8-a749-619ce9174fde response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3832024-08-28T23:30:35.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11f480e6-60c8-404a-8bd2-0063652877a6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3842024-08-28T23:30:35.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11f480e6-60c8-404a-8bd2-0063652877a6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3852024-08-28T23:30:35.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11f480e6-60c8-404a-8bd2-0063652877a6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3862024-08-28T23:30:36.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9af58c4f-0dec-4b59-bff7-ca0e6387015b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3872024-08-28T23:30:36.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9af58c4f-0dec-4b59-bff7-ca0e6387015b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3882024-08-28T23:30:36.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9af58c4f-0dec-4b59-bff7-ca0e6387015b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3892024-08-28T23:30:37.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2e805ad-7815-40fd-9820-852a2c35d64d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3902024-08-28T23:30:37.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2e805ad-7815-40fd-9820-852a2c35d64d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3912024-08-28T23:30:37.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2e805ad-7815-40fd-9820-852a2c35d64d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3922024-08-28T23:30:38.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f92e1874-8318-4cbc-9d28-f2713240dbd1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3932024-08-28T23:30:38.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f92e1874-8318-4cbc-9d28-f2713240dbd1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3942024-08-28T23:30:38.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f92e1874-8318-4cbc-9d28-f2713240dbd1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3952024-08-28T23:30:39.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ddfec36a-395e-4059-9a9a-37ce3d75e1aa roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3962024-08-28T23:30:39.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ddfec36a-395e-4059-9a9a-37ce3d75e1aa resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3972024-08-28T23:30:39.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ddfec36a-395e-4059-9a9a-37ce3d75e1aa response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3982024-08-28T23:30:40.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cbfa8fc-d09d-45f0-a56b-8ce2a9e86de1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
3992024-08-28T23:30:40.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cbfa8fc-d09d-45f0-a56b-8ce2a9e86de1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4002024-08-28T23:30:40.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cbfa8fc-d09d-45f0-a56b-8ce2a9e86de1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4012024-08-28T23:30:41.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fc86aef5-d1bf-4353-b8fc-0913ac5ed7ba roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4022024-08-28T23:30:41.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fc86aef5-d1bf-4353-b8fc-0913ac5ed7ba resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4032024-08-28T23:30:41.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fc86aef5-d1bf-4353-b8fc-0913ac5ed7ba response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4042024-08-28T23:30:42.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
4052024-08-28T23:30:42.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4062024-08-28T23:30:42.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4072024-08-28T23:30:42.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
4082024-08-28T23:30:42.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4092024-08-28T23:30:42.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4102024-08-28T23:30:42.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-08-28T23:30:42.093ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4122024-08-28T23:30:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4132024-08-28T23:30:42.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.784849ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4142024-08-28T23:30:42.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4152024-08-28T23:30:42.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4162024-08-28T23:30:42.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4172024-08-28T23:30:42.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4182024-08-28T23:30:42.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4192024-08-28T23:30:42.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4202024-08-28T23:30:42.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
4212024-08-28T23:30:42.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4222024-08-28T23:30:42.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4232024-08-28T23:30:42.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
4242024-08-28T23:30:42.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.722493ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
4252024-08-28T23:30:42.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = afec50f5-f6dd-4552-8079-55358f3e1bd7 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4262024-08-28T23:30:42.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = afec50f5-f6dd-4552-8079-55358f3e1bd7 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4272024-08-28T23:30:42.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = afec50f5-f6dd-4552-8079-55358f3e1bd7 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4282024-08-28T23:30:42.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 7225a8c9-7850-42b8-9263-bd0ae5d90550 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
4292024-08-28T23:30:43.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f08c697c-1f73-4736-b5eb-16fae2d006ac roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4302024-08-28T23:30:43.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f08c697c-1f73-4736-b5eb-16fae2d006ac resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4312024-08-28T23:30:43.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f08c697c-1f73-4736-b5eb-16fae2d006ac response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4322024-08-28T23:30:44.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 41a35050-53e4-4d9b-a765-8554ec3d06a8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4332024-08-28T23:30:44.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 41a35050-53e4-4d9b-a765-8554ec3d06a8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4342024-08-28T23:30:44.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 41a35050-53e4-4d9b-a765-8554ec3d06a8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4352024-08-28T23:30:45.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1281f106-d06f-4ab8-a8cc-056ebe570b1d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4362024-08-28T23:30:45.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1281f106-d06f-4ab8-a8cc-056ebe570b1d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4372024-08-28T23:30:45.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1281f106-d06f-4ab8-a8cc-056ebe570b1d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4382024-08-28T23:30:46.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f286c7ed-4147-4893-8a9f-b66f2d64c132 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4392024-08-28T23:30:46.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f286c7ed-4147-4893-8a9f-b66f2d64c132 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4402024-08-28T23:30:46.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f286c7ed-4147-4893-8a9f-b66f2d64c132 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4412024-08-28T23:30:47.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f51b10af-1664-41bb-a44a-0ce6ea64cf57 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4422024-08-28T23:30:47.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f51b10af-1664-41bb-a44a-0ce6ea64cf57 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4432024-08-28T23:30:47.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f51b10af-1664-41bb-a44a-0ce6ea64cf57 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4442024-08-28T23:30:48.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 12284de4-37fb-4a3f-86c2-fd7439584200 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4452024-08-28T23:30:48.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 12284de4-37fb-4a3f-86c2-fd7439584200 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4462024-08-28T23:30:48.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 12284de4-37fb-4a3f-86c2-fd7439584200 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4472024-08-28T23:30:49.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c9083ed-6610-4461-8ed1-32a59458b224 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4482024-08-28T23:30:49.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c9083ed-6610-4461-8ed1-32a59458b224 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4492024-08-28T23:30:49.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c9083ed-6610-4461-8ed1-32a59458b224 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4502024-08-28T23:30:50.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d77042-d5bc-4ea1-a503-2469072fa584 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4512024-08-28T23:30:50.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d77042-d5bc-4ea1-a503-2469072fa584 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4522024-08-28T23:30:50.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d77042-d5bc-4ea1-a503-2469072fa584 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4532024-08-28T23:30:51.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73acb002-9f56-4923-b164-6341533aef67 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4542024-08-28T23:30:51.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73acb002-9f56-4923-b164-6341533aef67 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4552024-08-28T23:30:51.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73acb002-9f56-4923-b164-6341533aef67 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
4562024-08-28T23:30:52.090ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
4572024-08-28T23:30:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
4582024-08-28T23:30:52.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
4592024-08-28T23:30:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
4602024-08-28T23:30:52.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
4612024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4622024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4632024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4642024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4652024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
4662024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
4672024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4682024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4692024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4702024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
4712024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4722024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
4732024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
4742024-08-28T23:30:52.091ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
4752024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.37\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
4762024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
4772024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
4782024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4792024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4802024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
4812024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
4822024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4832024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4842024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4852024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4862024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4872024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4882024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4892024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4902024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4912024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4922024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4932024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
4942024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
4952024-08-28T23:30:52.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
4962024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4972024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
4982024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4992024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5002024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5012024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5022024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
5032024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
5042024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5052024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5062024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
5072024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
5082024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5092024-08-28T23:30:52.091ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5102024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
5112024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5122024-08-28T23:30:52.091ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:20:52.091777873 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5132024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
5142024-08-28T23:30:52.091ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
5152024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5162024-08-28T23:30:52.091ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5172024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
5182024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
5192024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5202024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5212024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
5222024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5232024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5242024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
5252024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5262024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
5272024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5282024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
5292024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5302024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5312024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5322024-08-28T23:30:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1200, tv_nsec: 872197179 } })
5332024-08-28T23:30:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1200, tv_nsec: 872203609 } })
5342024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5352024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5362024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5372024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5382024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5392024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5402024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5412024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5422024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5432024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5442024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5452024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5462024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5472024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5482024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5492024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5502024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5512024-08-28T23:30:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5522024-08-28T23:30:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5532024-08-28T23:30:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.72065ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5542024-08-28T23:30:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
5552024-08-28T23:30:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.858913ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5562024-08-28T23:30:52.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5572024-08-28T23:30:52.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5582024-08-28T23:30:52.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5592024-08-28T23:30:52.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-08-28T23:30:52.095ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-08-28T23:30:52.095ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.627334ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5622024-08-28T23:30:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5632024-08-28T23:30:52.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5642024-08-28T23:30:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5652024-08-28T23:30:52.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1200, tv_nsec: 876794553 } })
5662024-08-28T23:30:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5672024-08-28T23:30:52.097ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5682024-08-28T23:30:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5692024-08-28T23:30:52.098ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5702024-08-28T23:30:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5712024-08-28T23:30:52.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5722024-08-28T23:30:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5732024-08-28T23:30:52.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1200, tv_nsec: 879147646 } })
5742024-08-28T23:30:52.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5752024-08-28T23:30:52.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.323588ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
5772024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.42939ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
5782024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5792024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5802024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5812024-08-28T23:30:52.102ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-08-28T23:30:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5832024-08-28T23:30:52.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5842024-08-28T23:30:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5852024-08-28T23:30:52.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5872024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5882024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5892024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5902024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-08-28T23:30:52.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922024-08-28T23:30:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5932024-08-28T23:30:52.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5942024-08-28T23:30:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5952024-08-28T23:30:52.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5962024-08-28T23:30:52.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5972024-08-28T23:30:52.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5982024-08-28T23:30:52.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5992024-08-28T23:30:52.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6002024-08-28T23:30:52.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6012024-08-28T23:30:52.116ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:20:52.091777873 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6022024-08-28T23:30:52.116ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.631879ms iteration = 4 status = {"expiration":"2024-08-28T23:20:52.091777873Z","pruned":[]}
6032024-08-28T23:30:52.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6042024-08-28T23:30:52.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6052024-08-28T23:30:52.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6062024-08-28T23:30:52.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6072024-08-28T23:30:52.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6082024-08-28T23:30:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6092024-08-28T23:30:52.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1200, tv_nsec: 900586977 } })
6102024-08-28T23:30:52.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
6112024-08-28T23:30:52.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-08-28T23:30:52.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6132024-08-28T23:30:52.130ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6142024-08-28T23:30:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6152024-08-28T23:30:52.141ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6162024-08-28T23:30:52.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6172024-08-28T23:30:52.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-08-28T23:30:52.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6192024-08-28T23:30:52.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6202024-08-28T23:30:52.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6212024-08-28T23:30:52.145ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
6222024-08-28T23:30:52.145ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
6232024-08-28T23:30:52.145ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.826891ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
6242024-08-28T23:30:52.147ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6252024-08-28T23:30:52.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6262024-08-28T23:30:52.150ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6272024-08-28T23:30:52.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6282024-08-28T23:30:52.150ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
6292024-08-28T23:30:52.150ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6302024-08-28T23:30:52.150ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6312024-08-28T23:30:52.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6322024-08-28T23:30:52.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332024-08-28T23:30:52.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-08-28T23:30:52.153ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352024-08-28T23:30:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6362024-08-28T23:30:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6372024-08-28T23:30:52.156ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6382024-08-28T23:30:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6392024-08-28T23:30:52.157ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6402024-08-28T23:30:52.157ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6412024-08-28T23:30:52.157ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6422024-08-28T23:30:52.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6432024-08-28T23:30:52.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6442024-08-28T23:30:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6452024-08-28T23:30:52.186ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6462024-08-28T23:30:52.186ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6472024-08-28T23:30:52.186ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6482024-08-28T23:30:52.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6492024-08-28T23:30:52.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6502024-08-28T23:30:52.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6512024-08-28T23:30:52.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6522024-08-28T23:30:52.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6532024-08-28T23:30:52.364ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6542024-08-28T23:30:52.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6552024-08-28T23:30:52.403ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6562024-08-28T23:30:52.403ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c59cf5f0-5c47-48b0-ad14-3c202904498b", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
6572024-08-28T23:30:52.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6582024-08-28T23:30:52.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6592024-08-28T23:30:52.410ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6602024-08-28T23:30:52.410ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6612024-08-28T23:30:52.410ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc9fb15-cd8f-4c91-9124-a7f76567036f", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
6622024-08-28T23:30:52.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6632024-08-28T23:30:52.413ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6642024-08-28T23:30:52.456ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
6652024-08-28T23:30:52.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-08-28T23:30:52.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6672024-08-28T23:30:52.458ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
6682024-08-28T23:30:52.458ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6692024-08-28T23:30:52.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6702024-08-28T23:30:52.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6712024-08-28T23:30:52.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6722024-08-28T23:30:52.458ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bae1f48e-5518-49c9-bed9-2e1332d584eb", "content-length": "26", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
6732024-08-28T23:30:52.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6742024-08-28T23:30:52.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6752024-08-28T23:30:52.459ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df6a25f3-f525-419f-b06d-112a54d8722c", "content-length": "64", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
6762024-08-28T23:30:52.459ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6772024-08-28T23:30:52.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6782024-08-28T23:30:52.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
6792024-08-28T23:30:52.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6802024-08-28T23:30:52.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 371.149612ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6812024-08-28T23:30:52.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6822024-08-28T23:30:52.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6832024-08-28T23:30:52.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-08-28T23:30:52.464ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6852024-08-28T23:30:52.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 372.267962ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6862024-08-28T23:30:52.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
6872024-08-28T23:30:52.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6882024-08-28T23:30:52.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6892024-08-28T23:30:52.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6902024-08-28T23:30:52.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6912024-08-28T23:30:52.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6922024-08-28T23:30:52.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6932024-08-28T23:30:52.470ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-08-28T23:30:52.472ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6952024-08-28T23:30:52.472ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6962024-08-28T23:30:52.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6972024-08-28T23:30:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6982024-08-28T23:30:52.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6992024-08-28T23:30:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7002024-08-28T23:30:52.484ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
7012024-08-28T23:30:52.484ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 393.779425ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
7022024-08-28T23:30:52.484ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 394.024909ms iteration = 3 status = {"nsuccess":5}
7032024-08-28T23:30:52.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 410.06175ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
7042024-08-28T23:30:52.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 411.217422ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7052024-08-28T23:30:52.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7062024-08-28T23:30:52.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7072024-08-28T23:30:52.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 415.916608ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
7082024-08-28T23:30:52.510ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7102024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7112024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7122024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7132024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7142024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7152024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7162024-08-28T23:30:52.513ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7172024-08-28T23:30:52.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-08-28T23:30:52.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7192024-08-28T23:30:52.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7202024-08-28T23:30:52.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7212024-08-28T23:30:52.518ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7222024-08-28T23:30:52.518ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7232024-08-28T23:30:52.519ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 427.210763ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7242024-08-28T23:30:52.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7252024-08-28T23:30:52.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7262024-08-28T23:30:52.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7272024-08-28T23:30:52.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-08-28T23:30:52.521ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
7292024-08-28T23:30:52.521ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7302024-08-28T23:30:52.521ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
7312024-08-28T23:30:52.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 430.986852ms iteration = 4 status = {"generation":1}
7322024-08-28T23:30:52.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7332024-08-28T23:30:52.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7342024-08-28T23:30:52.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7352024-08-28T23:30:52.555ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7362024-08-28T23:30:52.555ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
7372024-08-28T23:30:52.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7382024-08-28T23:30:52.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7392024-08-28T23:30:52.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7402024-08-28T23:30:52.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7412024-08-28T23:30:52.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-08-28T23:30:52.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7442024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7452024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7462024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7472024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7482024-08-28T23:30:52.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7492024-08-28T23:30:52.562ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
7502024-08-28T23:30:52.562ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7512024-08-28T23:30:52.562ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
7522024-08-28T23:30:52.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 471.119424ms iteration = 4 status = {"generation":2}
7532024-08-28T23:30:52.563ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7542024-08-28T23:30:52.563ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7f336779-20c5-423d-aad8-30904ba45c0d", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7552024-08-28T23:30:52.563ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7562024-08-28T23:30:52.565ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6091583c-4a34-4774-b470-cbfa06525438", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7572024-08-28T23:30:52.565ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7582024-08-28T23:30:52.567ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7592024-08-28T23:30:52.567ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 476.599443ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7602024-08-28T23:30:52.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7612024-08-28T23:30:52.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7622024-08-28T23:30:52.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-08-28T23:30:52.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7642024-08-28T23:30:52.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7652024-08-28T23:30:52.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7662024-08-28T23:30:52.581ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7672024-08-28T23:30:52.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-08-28T23:30:52.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7692024-08-28T23:30:52.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7702024-08-28T23:30:52.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7712024-08-28T23:30:52.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7722024-08-28T23:30:52.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7732024-08-28T23:30:52.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7742024-08-28T23:30:52.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7752024-08-28T23:30:52.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7762024-08-28T23:30:52.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7772024-08-28T23:30:52.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782024-08-28T23:30:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
7792024-08-28T23:30:52.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7802024-08-28T23:30:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7812024-08-28T23:30:52.606ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
7822024-08-28T23:30:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 515.206456ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7832024-08-28T23:30:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 516.750484ms iteration = 7 status = 0
7842024-08-28T23:30:52.625ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 534.257223ms iteration = 9 status = {"physical_disks_added":0}
7852024-08-28T23:30:52.637ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
7862024-08-28T23:30:52.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 546.245972ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7872024-08-28T23:30:52.720ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 628.987609ms iteration = 7 status = {}
7882024-08-28T23:30:52.720ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7892024-08-28T23:30:52.720ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "780e62f4-495f-48c5-87ec-bee458ec577c", "content-length": "1", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
7902024-08-28T23:30:52.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7912024-08-28T23:30:52.722ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1130 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 2e40292d-e87d-4688-9b04-0ffacd79b301 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
7922024-08-28T23:30:52.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7932024-08-28T23:30:52.724ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 633.389489ms iteration = 7 status = null
7942024-08-28T23:30:52.790ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7952024-08-28T23:30:52.791ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cd132cda-72a9-4e0e-b6bb-b3fd24f2731c", "content-length": "691", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
7962024-08-28T23:30:52.791ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7972024-08-28T23:30:52.791ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7982024-08-28T23:30:52.791ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7992024-08-28T23:30:52.793ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 702.00965ms iteration = 7 status = {}
8002024-08-28T23:30:52.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8012024-08-28T23:30:52.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "273734af-46bf-4ed2-94d2-f96161635479", "content-length": "372", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8022024-08-28T23:30:52.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8032024-08-28T23:30:52.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8042024-08-28T23:30:52.840ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8052024-08-28T23:30:52.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b5f2d1cf-bffd-4c7b-b4aa-34e4bcd1f784", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8062024-08-28T23:30:52.841ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8072024-08-28T23:30:52.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8082024-08-28T23:30:52.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8092024-08-28T23:30:52.843ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "213a4594-7ee7-442b-8f42-31e37c5a6352", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8102024-08-28T23:30:52.843ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8112024-08-28T23:30:52.845ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8963911d-ceef-4e5e-bb5b-d2b6214ce55f", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8122024-08-28T23:30:52.845ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8132024-08-28T23:30:52.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8142024-08-28T23:30:52.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8152024-08-28T23:30:52.847ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
8162024-08-28T23:30:52.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 756.089155ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8172024-08-28T23:30:52.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8182024-08-28T23:30:52.849ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a0c98ebd-d48e-4e86-8576-bcfd46ba2f3b", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8192024-08-28T23:30:52.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8202024-08-28T23:30:52.851ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 759.927635ms iteration = 7 status = {}
8212024-08-28T23:30:52.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8222024-08-28T23:30:52.853ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
8232024-08-28T23:30:52.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8242024-08-28T23:30:52.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8252024-08-28T23:30:52.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8262024-08-28T23:30:52.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa76d628-028c-426d-ae32-57195bd99a4a", "content-length": "121", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8272024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8282024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
8292024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8302024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8312024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
8322024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
8332024-08-28T23:30:52.861ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
8342024-08-28T23:30:52.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352024-08-28T23:30:52.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362024-08-28T23:30:52.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8372024-08-28T23:30:52.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96e149f2-2580-4503-8fc2-e3a9fc7c4532", "content-length": "2", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8382024-08-28T23:30:52.864ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8392024-08-28T23:30:52.864ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "625f9c78-0c6a-400e-9039-863721d1b622", "content-length": "52", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8402024-08-28T23:30:52.864ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
8412024-08-28T23:30:52.864ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8422024-08-28T23:30:52.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9ed45425-4b8a-4ad3-bb59-92808e1f9063", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8432024-08-28T23:30:52.961ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
8442024-08-28T23:30:52.961ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8452024-08-28T23:30:52.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f7ce72b2-0b9a-4cfe-bba7-57f366ddb174 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8462024-08-28T23:30:52.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f7ce72b2-0b9a-4cfe-bba7-57f366ddb174 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8472024-08-28T23:30:52.962ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e3dd7dc-b6a1-48b2-8f69-dee55a04bf56", "content-length": "667", "date": "Wed, 28 Aug 2024 23:30:52 GMT"} })
8482024-08-28T23:30:52.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-08-28T23:30:52.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-08-28T23:30:52.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f7ce72b2-0b9a-4cfe-bba7-57f366ddb174 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8512024-08-28T23:30:52.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8522024-08-28T23:30:52.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8532024-08-28T23:30:52.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8542024-08-28T23:30:52.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8552024-08-28T23:30:52.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8562024-08-28T23:30:52.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8572024-08-28T23:30:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 997.38489ms iteration = 7 status = {}
8582024-08-28T23:30:53.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cd14898d-be87-42ad-a2f4-4868c2407911 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8592024-08-28T23:30:53.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cd14898d-be87-42ad-a2f4-4868c2407911 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8602024-08-28T23:30:53.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cd14898d-be87-42ad-a2f4-4868c2407911 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8612024-08-28T23:30:55.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = da2a22dc-f802-44ac-b6f0-1d1d097ca379 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8622024-08-28T23:30:55.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = da2a22dc-f802-44ac-b6f0-1d1d097ca379 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8632024-08-28T23:30:55.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = da2a22dc-f802-44ac-b6f0-1d1d097ca379 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8642024-08-28T23:30:56.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 315533d3-bb93-4157-ab10-4ecda5fb4000 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8652024-08-28T23:30:56.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 315533d3-bb93-4157-ab10-4ecda5fb4000 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8662024-08-28T23:30:56.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 315533d3-bb93-4157-ab10-4ecda5fb4000 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8672024-08-28T23:30:57.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 09ca6637-792d-43a4-9f48-d88386a960a1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8682024-08-28T23:30:57.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 09ca6637-792d-43a4-9f48-d88386a960a1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8692024-08-28T23:30:57.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 09ca6637-792d-43a4-9f48-d88386a960a1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8702024-08-28T23:30:58.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99e850e9-b4d9-4e2d-85aa-020600240675 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8712024-08-28T23:30:58.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99e850e9-b4d9-4e2d-85aa-020600240675 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8722024-08-28T23:30:58.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99e850e9-b4d9-4e2d-85aa-020600240675 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8732024-08-28T23:30:59.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f9e10f3-6ebb-40f8-8625-ad68d80355b9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8742024-08-28T23:30:59.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f9e10f3-6ebb-40f8-8625-ad68d80355b9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8752024-08-28T23:30:59.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f9e10f3-6ebb-40f8-8625-ad68d80355b9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8762024-08-28T23:31:00.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6484c676-2606-4669-9e03-ef3aff0a31e6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8772024-08-28T23:31:00.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6484c676-2606-4669-9e03-ef3aff0a31e6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8782024-08-28T23:31:00.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6484c676-2606-4669-9e03-ef3aff0a31e6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8792024-08-28T23:31:01.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9b50600-2894-4374-b8e2-13b2712be03a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8802024-08-28T23:31:01.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9b50600-2894-4374-b8e2-13b2712be03a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8812024-08-28T23:31:01.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9b50600-2894-4374-b8e2-13b2712be03a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
8822024-08-28T23:31:02.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
8832024-08-28T23:31:02.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842024-08-28T23:31:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852024-08-28T23:31:02.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
8862024-08-28T23:31:02.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8872024-08-28T23:31:02.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8882024-08-28T23:31:02.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892024-08-28T23:31:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8902024-08-28T23:31:02.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912024-08-28T23:31:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8922024-08-28T23:31:02.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8932024-08-28T23:31:02.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8942024-08-28T23:31:02.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8952024-08-28T23:31:02.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8962024-08-28T23:31:02.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8972024-08-28T23:31:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
8982024-08-28T23:31:02.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-08-28T23:31:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-08-28T23:31:02.136ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
9012024-08-28T23:31:02.136ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.304915ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
9022024-08-28T23:31:02.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.83145ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9032024-08-28T23:31:02.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 892dae73-2b24-4b0f-9a5f-a20b46d4f13c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9042024-08-28T23:31:02.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 892dae73-2b24-4b0f-9a5f-a20b46d4f13c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9052024-08-28T23:31:02.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 892dae73-2b24-4b0f-9a5f-a20b46d4f13c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9062024-08-28T23:31:02.721ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 396 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 121bc244-af6e-4649-93d5-bf164009f153 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
9072024-08-28T23:31:03.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ff043f7-5715-4d83-b03c-67c1d072fc2e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9082024-08-28T23:31:03.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ff043f7-5715-4d83-b03c-67c1d072fc2e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9092024-08-28T23:31:03.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ff043f7-5715-4d83-b03c-67c1d072fc2e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9102024-08-28T23:31:04.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73af6bb4-93c4-4c8e-b07c-91fe5f261245 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9112024-08-28T23:31:04.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73af6bb4-93c4-4c8e-b07c-91fe5f261245 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9122024-08-28T23:31:04.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 73af6bb4-93c4-4c8e-b07c-91fe5f261245 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9132024-08-28T23:31:05.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3fe8cb2e-7e9a-4879-bd6a-8daf17099b2a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9142024-08-28T23:31:05.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3fe8cb2e-7e9a-4879-bd6a-8daf17099b2a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9152024-08-28T23:31:05.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3fe8cb2e-7e9a-4879-bd6a-8daf17099b2a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9162024-08-28T23:31:06.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 90b2094b-f918-40e4-aa8c-57425e416f5c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9172024-08-28T23:31:06.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 90b2094b-f918-40e4-aa8c-57425e416f5c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9182024-08-28T23:31:06.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 90b2094b-f918-40e4-aa8c-57425e416f5c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9192024-08-28T23:31:07.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83b473bf-666c-4e84-8b8e-b8d82fe78548 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9202024-08-28T23:31:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83b473bf-666c-4e84-8b8e-b8d82fe78548 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9212024-08-28T23:31:07.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83b473bf-666c-4e84-8b8e-b8d82fe78548 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9222024-08-28T23:31:08.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 98bd608c-998d-440e-b24a-c744fffd5c18 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9232024-08-28T23:31:08.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 98bd608c-998d-440e-b24a-c744fffd5c18 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9242024-08-28T23:31:08.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 98bd608c-998d-440e-b24a-c744fffd5c18 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9252024-08-28T23:31:09.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 018c6360-1673-44dc-b086-bda68cb53822 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9262024-08-28T23:31:09.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 018c6360-1673-44dc-b086-bda68cb53822 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9272024-08-28T23:31:09.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 018c6360-1673-44dc-b086-bda68cb53822 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9282024-08-28T23:31:10.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3752a0e5-cd5f-41b4-a078-0d720549e539 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9292024-08-28T23:31:10.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3752a0e5-cd5f-41b4-a078-0d720549e539 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9302024-08-28T23:31:10.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3752a0e5-cd5f-41b4-a078-0d720549e539 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9312024-08-28T23:31:11.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f57f710-06b5-4f8f-87a9-04bd2264d0a9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9322024-08-28T23:31:11.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f57f710-06b5-4f8f-87a9-04bd2264d0a9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9332024-08-28T23:31:11.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f57f710-06b5-4f8f-87a9-04bd2264d0a9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9342024-08-28T23:31:12.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
9352024-08-28T23:31:12.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9362024-08-28T23:31:12.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9372024-08-28T23:31:12.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
9382024-08-28T23:31:12.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9392024-08-28T23:31:12.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9402024-08-28T23:31:12.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9412024-08-28T23:31:12.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9422024-08-28T23:31:12.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9432024-08-28T23:31:12.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9442024-08-28T23:31:12.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9452024-08-28T23:31:12.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9462024-08-28T23:31:12.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9472024-08-28T23:31:12.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9482024-08-28T23:31:12.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9492024-08-28T23:31:12.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
9502024-08-28T23:31:12.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9512024-08-28T23:31:12.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9522024-08-28T23:31:12.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.096044ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9532024-08-28T23:31:12.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
9542024-08-28T23:31:12.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 143.752679ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
9552024-08-28T23:31:12.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb1dfb0f-9a64-43a4-8144-da212a3652ba roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9562024-08-28T23:31:12.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb1dfb0f-9a64-43a4-8144-da212a3652ba resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9572024-08-28T23:31:12.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb1dfb0f-9a64-43a4-8144-da212a3652ba response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9582024-08-28T23:31:12.722ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1020 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = fcfb5f5b-0759-4bb5-9c88-8da3d0a4a19f response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
9592024-08-28T23:31:13.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5c52c499-fe5f-450b-b3d2-a7605f034a65 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9602024-08-28T23:31:13.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5c52c499-fe5f-450b-b3d2-a7605f034a65 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9612024-08-28T23:31:13.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5c52c499-fe5f-450b-b3d2-a7605f034a65 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9622024-08-28T23:31:14.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de15a946-a30f-41a0-aa54-3aeb8052dad0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9632024-08-28T23:31:14.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de15a946-a30f-41a0-aa54-3aeb8052dad0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9642024-08-28T23:31:14.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = de15a946-a30f-41a0-aa54-3aeb8052dad0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9652024-08-28T23:31:15.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2a1307a-8015-49c4-bf2f-02725947a353 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9662024-08-28T23:31:15.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2a1307a-8015-49c4-bf2f-02725947a353 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9672024-08-28T23:31:15.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f2a1307a-8015-49c4-bf2f-02725947a353 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9682024-08-28T23:31:16.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 464283e8-0bfd-4578-b066-42c608cf29b4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9692024-08-28T23:31:16.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 464283e8-0bfd-4578-b066-42c608cf29b4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9702024-08-28T23:31:16.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 464283e8-0bfd-4578-b066-42c608cf29b4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9712024-08-28T23:31:17.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83514f8d-ae9d-4690-8371-d658bf6ff48e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9722024-08-28T23:31:17.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83514f8d-ae9d-4690-8371-d658bf6ff48e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9732024-08-28T23:31:17.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 83514f8d-ae9d-4690-8371-d658bf6ff48e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9742024-08-28T23:31:18.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33c18e93-3931-4cd0-872c-7ef17171a644 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9752024-08-28T23:31:18.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33c18e93-3931-4cd0-872c-7ef17171a644 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9762024-08-28T23:31:18.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33c18e93-3931-4cd0-872c-7ef17171a644 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9772024-08-28T23:31:19.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f836389b-a3c6-46b1-bfdd-372765ad3653 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9782024-08-28T23:31:19.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f836389b-a3c6-46b1-bfdd-372765ad3653 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9792024-08-28T23:31:19.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f836389b-a3c6-46b1-bfdd-372765ad3653 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9802024-08-28T23:31:20.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5127844-03a0-4cbc-8e3e-0e214ef26545 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9812024-08-28T23:31:20.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5127844-03a0-4cbc-8e3e-0e214ef26545 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9822024-08-28T23:31:20.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5127844-03a0-4cbc-8e3e-0e214ef26545 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9832024-08-28T23:31:21.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b79f9261-fa10-4af4-8162-b170ccdcf9e8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9842024-08-28T23:31:21.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b79f9261-fa10-4af4-8162-b170ccdcf9e8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9852024-08-28T23:31:21.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b79f9261-fa10-4af4-8162-b170ccdcf9e8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
9862024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
9872024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9882024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
9892024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
9902024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
9912024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
9922024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9932024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9942024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9952024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9962024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9972024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9982024-08-28T23:31:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9992024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
10002024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
10012024-08-28T23:31:22.092ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
10022024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
10032024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10042024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10052024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
10062024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10072024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
10082024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10092024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10102024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
10112024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10122024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
10132024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
10142024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10152024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10162024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
10172024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10182024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
10192024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10202024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
10212024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10222024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10232024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10242024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10252024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10262024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10272024-08-28T23:31:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10282024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10292024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10302024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10312024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10322024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10332024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10342024-08-28T23:31:22.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10352024-08-28T23:31:22.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1230, tv_nsec: 874234026 } })
10362024-08-28T23:31:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
10372024-08-28T23:31:22.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.144498ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10382024-08-28T23:31:22.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392024-08-28T23:31:22.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10402024-08-28T23:31:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1230, tv_nsec: 875746374 } })
10412024-08-28T23:31:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10422024-08-28T23:31:22.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10432024-08-28T23:31:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10442024-08-28T23:31:22.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
10452024-08-28T23:31:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10462024-08-28T23:31:22.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10472024-08-28T23:31:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10482024-08-28T23:31:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10492024-08-28T23:31:22.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502024-08-28T23:31:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512024-08-28T23:31:22.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522024-08-28T23:31:22.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10532024-08-28T23:31:22.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10542024-08-28T23:31:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10552024-08-28T23:31:22.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10562024-08-28T23:31:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10572024-08-28T23:31:22.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1230, tv_nsec: 888376024 } })
10582024-08-28T23:31:22.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
10592024-08-28T23:31:22.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10602024-08-28T23:31:22.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10612024-08-28T23:31:22.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622024-08-28T23:31:22.137ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10632024-08-28T23:31:22.137ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10642024-08-28T23:31:22.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10652024-08-28T23:31:22.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10662024-08-28T23:31:22.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10672024-08-28T23:31:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10682024-08-28T23:31:22.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10692024-08-28T23:31:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10702024-08-28T23:31:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10712024-08-28T23:31:22.141ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10722024-08-28T23:31:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10732024-08-28T23:31:22.142ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10742024-08-28T23:31:22.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10752024-08-28T23:31:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10762024-08-28T23:31:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772024-08-28T23:31:22.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10782024-08-28T23:31:22.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.907956ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
10792024-08-28T23:31:22.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802024-08-28T23:31:22.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10812024-08-28T23:31:22.145ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10822024-08-28T23:31:22.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10832024-08-28T23:31:22.145ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842024-08-28T23:31:22.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10852024-08-28T23:31:22.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10862024-08-28T23:31:22.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10872024-08-28T23:31:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10882024-08-28T23:31:22.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10892024-08-28T23:31:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10902024-08-28T23:31:22.148ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10912024-08-28T23:31:22.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10922024-08-28T23:31:22.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932024-08-28T23:31:22.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
10942024-08-28T23:31:22.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10952024-08-28T23:31:22.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10962024-08-28T23:31:22.175ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
10972024-08-28T23:31:22.175ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.054021ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
10982024-08-28T23:31:22.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.824352ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10992024-08-28T23:31:22.179ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11002024-08-28T23:31:22.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11012024-08-28T23:31:22.184ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.432196ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11022024-08-28T23:31:22.184ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
11032024-08-28T23:31:22.184ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11042024-08-28T23:31:22.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.450246ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
11052024-08-28T23:31:22.184ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.23409ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
11062024-08-28T23:31:22.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11072024-08-28T23:31:22.230ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
11082024-08-28T23:31:22.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.946833ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11092024-08-28T23:31:22.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11102024-08-28T23:31:22.238ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
11112024-08-28T23:31:22.238ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11122024-08-28T23:31:22.238ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59a42a3f-d66b-48d0-a6d0-be82804f486a", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11132024-08-28T23:31:22.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11142024-08-28T23:31:22.238ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11152024-08-28T23:31:22.238ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.122623ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11162024-08-28T23:31:22.240ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
11172024-08-28T23:31:22.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11182024-08-28T23:31:22.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11192024-08-28T23:31:22.273ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.979085ms iteration = 10 status = {"physical_disks_added":0}
11202024-08-28T23:31:22.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
11212024-08-28T23:31:22.280ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11222024-08-28T23:31:22.280ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96d6c6cf-2e6f-47d0-af9c-1587bd9b5ddb", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11232024-08-28T23:31:22.280ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11242024-08-28T23:31:22.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11252024-08-28T23:31:22.313ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
11262024-08-28T23:31:22.313ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11272024-08-28T23:31:22.314ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5a79d2-9dce-4813-8943-830831f0091e", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11282024-08-28T23:31:22.314ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11292024-08-28T23:31:22.315ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11302024-08-28T23:31:22.451ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11312024-08-28T23:31:22.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11322024-08-28T23:31:22.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11332024-08-28T23:31:22.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342024-08-28T23:31:22.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
11352024-08-28T23:31:22.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11362024-08-28T23:31:22.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11372024-08-28T23:31:22.487ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 395.274892ms iteration = 8 status = 0
11382024-08-28T23:31:22.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2c797b7-b86b-4c49-991c-401649af5a80", "content-length": "372", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11392024-08-28T23:31:22.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11402024-08-28T23:31:22.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11412024-08-28T23:31:22.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11422024-08-28T23:31:22.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11432024-08-28T23:31:22.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11442024-08-28T23:31:22.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11452024-08-28T23:31:22.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11462024-08-28T23:31:22.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0bf58f68-9723-473b-b077-d5f91825a8cf", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11472024-08-28T23:31:22.503ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 410.831835ms iteration = 8 status = {}
11482024-08-28T23:31:22.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11492024-08-28T23:31:22.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11502024-08-28T23:31:22.539ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11512024-08-28T23:31:22.539ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f34b77ec-0b13-498f-a3ae-5bbe9064e271", "content-length": "1", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11522024-08-28T23:31:22.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11532024-08-28T23:31:22.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11542024-08-28T23:31:22.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 451.485925ms iteration = 8 status = null
11552024-08-28T23:31:22.552ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 461.146502ms iteration = 8 status = {}
11562024-08-28T23:31:22.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11572024-08-28T23:31:22.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11582024-08-28T23:31:22.555ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
11592024-08-28T23:31:22.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11602024-08-28T23:31:22.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11612024-08-28T23:31:22.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11622024-08-28T23:31:22.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11632024-08-28T23:31:22.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11642024-08-28T23:31:22.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11652024-08-28T23:31:22.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-08-28T23:31:22.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11672024-08-28T23:31:22.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11682024-08-28T23:31:22.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11692024-08-28T23:31:22.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2729dbea-4656-4f90-b7fb-b5b1a277eddd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
11702024-08-28T23:31:22.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2729dbea-4656-4f90-b7fb-b5b1a277eddd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
11712024-08-28T23:31:22.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2729dbea-4656-4f90-b7fb-b5b1a277eddd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
11722024-08-28T23:31:22.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11732024-08-28T23:31:22.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4de6cf48-b708-441d-a45a-c2de0023f8af", "content-length": "121", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11742024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11752024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
11762024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11772024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11782024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
11792024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
11802024-08-28T23:31:22.667ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
11812024-08-28T23:31:22.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11822024-08-28T23:31:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11832024-08-28T23:31:22.670ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11842024-08-28T23:31:22.670ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a4a832e-ee68-44d0-9481-7f21e6bcc6fb", "content-length": "2", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11852024-08-28T23:31:22.670ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11862024-08-28T23:31:22.670ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1bf7c446-92bb-4089-8a5f-a987b27795ee", "content-length": "52", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
11872024-08-28T23:31:22.670ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
11882024-08-28T23:31:22.670ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11892024-08-28T23:31:22.692ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
11902024-08-28T23:31:22.692ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
11912024-08-28T23:31:22.722ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
11922024-08-28T23:31:22.722ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60229
11932024-08-28T23:31:22.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60229 req_id = 7b96f31d-3a54-45af-b749-3f335e8a2da3 roles = RoleSet { roles: {} } uri = /metrics/producers
11942024-08-28T23:31:22.723ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1075 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 36e423e3-15d8-4bfd-846b-2b9c62a4e77d response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
11952024-08-28T23:31:22.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60229 req_id = 7b96f31d-3a54-45af-b749-3f335e8a2da3 resource = Database result = Ok(()) uri = /metrics/producers
11962024-08-28T23:31:22.781ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 099a839b-4790-447a-827a-80c4d38e82a0
11972024-08-28T23:31:22.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60229 req_id = 7b96f31d-3a54-45af-b749-3f335e8a2da3 roles = RoleSet { roles: {} } uri = /metrics/producers
11982024-08-28T23:31:22.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60229 req_id = 7b96f31d-3a54-45af-b749-3f335e8a2da3 resource = Database result = Ok(()) uri = /metrics/producers
11992024-08-28T23:31:22.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12002024-08-28T23:31:22.814ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 uri = http://[fd00:1122:3344:101::d]:12223/producers
12012024-08-28T23:31:22.816ZDEBGnexus: client response oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4689fc9e-b1d6-4909-b691-47c37d879ae6", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
12022024-08-28T23:31:22.816ZINFOnexus: assigned collector to new producer collector_id = 099a839b-4790-447a-827a-80c4d38e82a0 file = nexus/src/app/oximeter.rs:125 producer_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
12032024-08-28T23:31:22.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94403 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60229 req_id = 7b96f31d-3a54-45af-b749-3f335e8a2da3 response_code = 201 uri = /metrics/producers
12042024-08-28T23:31:22.817ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "7b96f31d-3a54-45af-b749-3f335e8a2da3", "content-length": "41", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
12052024-08-28T23:31:22.818ZDEBGnexus (producer-registration-task): registered with nexus successfully
12062024-08-28T23:31:22.818ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
12072024-08-28T23:31:22.828ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8859eb02-9453-4eb9-b3ae-de4540b4e2a4", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
12082024-08-28T23:31:22.828ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
12092024-08-28T23:31:22.828ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12102024-08-28T23:31:22.829ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91821e27-5d99-470b-b320-d72cf80ae894", "content-length": "667", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
12112024-08-28T23:31:22.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12122024-08-28T23:31:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12132024-08-28T23:31:22.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6730ad69-1924-4330-9902-4c6cbd74e303", "content-length": "691", "date": "Wed, 28 Aug 2024 23:31:22 GMT"} })
12142024-08-28T23:31:22.829ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12152024-08-28T23:31:22.829ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12162024-08-28T23:31:22.829ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12172024-08-28T23:31:22.831ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 738.846781ms iteration = 8 status = {}
12182024-08-28T23:31:22.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12192024-08-28T23:31:22.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12202024-08-28T23:31:22.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12212024-08-28T23:31:22.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12222024-08-28T23:31:22.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12232024-08-28T23:31:22.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12242024-08-28T23:31:22.851ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 759.209422ms iteration = 8 status = {}
12252024-08-28T23:31:23.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9cdb7346-03fa-4243-94ac-0c224ccce97d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12262024-08-28T23:31:23.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9cdb7346-03fa-4243-94ac-0c224ccce97d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12272024-08-28T23:31:23.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9cdb7346-03fa-4243-94ac-0c224ccce97d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12282024-08-28T23:31:24.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10bb3236-3d8a-475c-b336-04aae645ae40 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12292024-08-28T23:31:24.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10bb3236-3d8a-475c-b336-04aae645ae40 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12302024-08-28T23:31:24.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10bb3236-3d8a-475c-b336-04aae645ae40 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12312024-08-28T23:31:25.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29197e90-fb42-4bd7-8359-d40a343ea4ca roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12322024-08-28T23:31:25.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29197e90-fb42-4bd7-8359-d40a343ea4ca resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12332024-08-28T23:31:25.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29197e90-fb42-4bd7-8359-d40a343ea4ca response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12342024-08-28T23:31:26.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0bc872a-7839-41d0-96b0-0b2617af178e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12352024-08-28T23:31:26.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0bc872a-7839-41d0-96b0-0b2617af178e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12362024-08-28T23:31:26.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0bc872a-7839-41d0-96b0-0b2617af178e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12372024-08-28T23:31:27.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6fe59c0-49a5-4cad-b180-9a679db34307 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12382024-08-28T23:31:27.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6fe59c0-49a5-4cad-b180-9a679db34307 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12392024-08-28T23:31:27.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6fe59c0-49a5-4cad-b180-9a679db34307 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12402024-08-28T23:31:28.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fb6978d4-127b-4df0-8396-3052edb0292b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12412024-08-28T23:31:28.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fb6978d4-127b-4df0-8396-3052edb0292b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12422024-08-28T23:31:28.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fb6978d4-127b-4df0-8396-3052edb0292b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12432024-08-28T23:31:29.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ef35c77-8223-4f21-ab53-286497cee564 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12442024-08-28T23:31:29.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ef35c77-8223-4f21-ab53-286497cee564 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12452024-08-28T23:31:29.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ef35c77-8223-4f21-ab53-286497cee564 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12462024-08-28T23:31:30.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b637221a-27e1-4941-8d08-ece4bb4d34c8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12472024-08-28T23:31:30.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b637221a-27e1-4941-8d08-ece4bb4d34c8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12482024-08-28T23:31:30.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b637221a-27e1-4941-8d08-ece4bb4d34c8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12492024-08-28T23:31:31.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b574c7ab-9318-4776-b8de-0e1de21d3c84 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12502024-08-28T23:31:31.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b574c7ab-9318-4776-b8de-0e1de21d3c84 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12512024-08-28T23:31:31.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b574c7ab-9318-4776-b8de-0e1de21d3c84 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12522024-08-28T23:31:32.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
12532024-08-28T23:31:32.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12542024-08-28T23:31:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12552024-08-28T23:31:32.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
12562024-08-28T23:31:32.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12572024-08-28T23:31:32.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12582024-08-28T23:31:32.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-08-28T23:31:32.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12602024-08-28T23:31:32.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12612024-08-28T23:31:32.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12622024-08-28T23:31:32.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12632024-08-28T23:31:32.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12642024-08-28T23:31:32.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12652024-08-28T23:31:32.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12662024-08-28T23:31:32.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.28661ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12672024-08-28T23:31:32.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682024-08-28T23:31:32.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
12692024-08-28T23:31:32.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12702024-08-28T23:31:32.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12712024-08-28T23:31:32.269ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
12722024-08-28T23:31:32.269ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 178.933ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
12732024-08-28T23:31:32.818ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 471 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 6a08d72a-38ad-4c84-835a-b0f342dc7875 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
12742024-08-28T23:31:32.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eda0cc-d357-4fd6-873c-61b5871d9426 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12752024-08-28T23:31:32.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eda0cc-d357-4fd6-873c-61b5871d9426 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12762024-08-28T23:31:32.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eda0cc-d357-4fd6-873c-61b5871d9426 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12772024-08-28T23:31:33.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 452d98ca-0c19-447d-a883-15e98d35b8f0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12782024-08-28T23:31:33.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 452d98ca-0c19-447d-a883-15e98d35b8f0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12792024-08-28T23:31:33.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 452d98ca-0c19-447d-a883-15e98d35b8f0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12802024-08-28T23:31:34.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a73a78af-bb3b-41f0-a0f8-2313072f56cd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12812024-08-28T23:31:34.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a73a78af-bb3b-41f0-a0f8-2313072f56cd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12822024-08-28T23:31:34.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a73a78af-bb3b-41f0-a0f8-2313072f56cd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12832024-08-28T23:31:35.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ce3fcaa-c839-4e95-a7c7-7131f63a0ef3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12842024-08-28T23:31:35.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ce3fcaa-c839-4e95-a7c7-7131f63a0ef3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12852024-08-28T23:31:35.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2ce3fcaa-c839-4e95-a7c7-7131f63a0ef3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12862024-08-28T23:31:36.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c13910b-cfc9-4c33-b665-b9eeff43a32c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12872024-08-28T23:31:36.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c13910b-cfc9-4c33-b665-b9eeff43a32c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12882024-08-28T23:31:36.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8c13910b-cfc9-4c33-b665-b9eeff43a32c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12892024-08-28T23:31:37.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8aa3d98e-9ac3-4c23-8aa4-f4f4e90eee8a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12902024-08-28T23:31:37.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8aa3d98e-9ac3-4c23-8aa4-f4f4e90eee8a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12912024-08-28T23:31:37.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8aa3d98e-9ac3-4c23-8aa4-f4f4e90eee8a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12922024-08-28T23:31:38.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64b910f2-4479-44f4-8813-d21b90e230a2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12932024-08-28T23:31:38.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64b910f2-4479-44f4-8813-d21b90e230a2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12942024-08-28T23:31:38.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64b910f2-4479-44f4-8813-d21b90e230a2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12952024-08-28T23:31:39.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e9cd57ea-cdbd-4145-bae2-c4dbf4d31888 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12962024-08-28T23:31:39.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e9cd57ea-cdbd-4145-bae2-c4dbf4d31888 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12972024-08-28T23:31:39.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e9cd57ea-cdbd-4145-bae2-c4dbf4d31888 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12982024-08-28T23:31:41.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ade6999-6717-439c-b536-eae4bea7eeda roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
12992024-08-28T23:31:41.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ade6999-6717-439c-b536-eae4bea7eeda resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13002024-08-28T23:31:41.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ade6999-6717-439c-b536-eae4bea7eeda response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13012024-08-28T23:31:42.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f775a2ad-2236-4586-becd-31aaa2803c9f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13022024-08-28T23:31:42.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f775a2ad-2236-4586-becd-31aaa2803c9f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13032024-08-28T23:31:42.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f775a2ad-2236-4586-becd-31aaa2803c9f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13042024-08-28T23:31:42.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
13052024-08-28T23:31:42.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13062024-08-28T23:31:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13072024-08-28T23:31:42.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-08-28T23:31:42.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
13092024-08-28T23:31:42.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13102024-08-28T23:31:42.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13112024-08-28T23:31:42.093ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13122024-08-28T23:31:42.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13132024-08-28T23:31:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13142024-08-28T23:31:42.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13152024-08-28T23:31:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13162024-08-28T23:31:42.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13172024-08-28T23:31:42.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13182024-08-28T23:31:42.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13192024-08-28T23:31:42.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
13202024-08-28T23:31:42.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13212024-08-28T23:31:42.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13222024-08-28T23:31:42.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
13232024-08-28T23:31:42.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.325504ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
13242024-08-28T23:31:42.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.285475ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13252024-08-28T23:31:42.817ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1065 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 75fe165f-eba1-47b8-8654-d5814d27ae51 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
13262024-08-28T23:31:43.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c30963c5-746e-4eaf-a63f-e1203921cdc5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13272024-08-28T23:31:43.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c30963c5-746e-4eaf-a63f-e1203921cdc5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13282024-08-28T23:31:43.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c30963c5-746e-4eaf-a63f-e1203921cdc5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13292024-08-28T23:31:44.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eb5488b2-de21-49a8-a7fa-00f26ac2ef34 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13302024-08-28T23:31:44.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eb5488b2-de21-49a8-a7fa-00f26ac2ef34 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13312024-08-28T23:31:44.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eb5488b2-de21-49a8-a7fa-00f26ac2ef34 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13322024-08-28T23:31:45.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 039f7dd9-02e4-4abd-96ad-d36d938bbfd5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13332024-08-28T23:31:45.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 039f7dd9-02e4-4abd-96ad-d36d938bbfd5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13342024-08-28T23:31:45.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 039f7dd9-02e4-4abd-96ad-d36d938bbfd5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13352024-08-28T23:31:46.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3811f717-c9e7-42a0-b062-e05d2ab0f44b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13362024-08-28T23:31:46.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3811f717-c9e7-42a0-b062-e05d2ab0f44b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13372024-08-28T23:31:46.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3811f717-c9e7-42a0-b062-e05d2ab0f44b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13382024-08-28T23:31:47.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fa5c413-4e70-45ea-a2b6-1133cd7d324a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13392024-08-28T23:31:47.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fa5c413-4e70-45ea-a2b6-1133cd7d324a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13402024-08-28T23:31:47.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fa5c413-4e70-45ea-a2b6-1133cd7d324a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13412024-08-28T23:31:48.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 08aedd35-28f1-44d9-9386-09a4930d8ab4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13422024-08-28T23:31:48.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 08aedd35-28f1-44d9-9386-09a4930d8ab4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13432024-08-28T23:31:48.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 08aedd35-28f1-44d9-9386-09a4930d8ab4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13442024-08-28T23:31:49.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28363db6-12d3-4529-9d75-26b4eb074466 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13452024-08-28T23:31:49.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28363db6-12d3-4529-9d75-26b4eb074466 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13462024-08-28T23:31:49.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28363db6-12d3-4529-9d75-26b4eb074466 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13472024-08-28T23:31:50.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2d62b30-82c2-4597-baae-8eaedd248b24 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13482024-08-28T23:31:50.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2d62b30-82c2-4597-baae-8eaedd248b24 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13492024-08-28T23:31:50.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2d62b30-82c2-4597-baae-8eaedd248b24 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13502024-08-28T23:31:51.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64c9b21d-6728-4331-ab91-2670579a7f95 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13512024-08-28T23:31:51.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64c9b21d-6728-4331-ab91-2670579a7f95 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13522024-08-28T23:31:51.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 64c9b21d-6728-4331-ab91-2670579a7f95 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
13532024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
13542024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
13552024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
13562024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
13572024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
13582024-08-28T23:31:52.090ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
13592024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13602024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.44\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
13612024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
13622024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
13632024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13642024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
13652024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13662024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13672024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
13682024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13692024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13702024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
13712024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13722024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
13732024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13742024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13752024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
13762024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
13772024-08-28T23:31:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13782024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13792024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13802024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13812024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13822024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13832024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13842024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
13852024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
13862024-08-28T23:31:52.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
13872024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13882024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
13892024-08-28T23:31:52.091ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13902024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13912024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13922024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
13932024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13942024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
13952024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13962024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
13972024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13982024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
13992024-08-28T23:31:52.091ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:21:52.091862765 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14002024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14012024-08-28T23:31:52.091ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
14022024-08-28T23:31:52.091ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
14032024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14042024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
14052024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14062024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
14072024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14082024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
14092024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14102024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
14112024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14122024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14132024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
14142024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14152024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
14162024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14172024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
14182024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14192024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14202024-08-28T23:31:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1260, tv_nsec: 872939273 } })
14212024-08-28T23:31:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1260, tv_nsec: 872953913 } })
14222024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14232024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14242024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14252024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14262024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14272024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14282024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14292024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14302024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14312024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14322024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14332024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14342024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14352024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14362024-08-28T23:31:52.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-08-28T23:31:52.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382024-08-28T23:31:52.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14392024-08-28T23:31:52.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14402024-08-28T23:31:52.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412024-08-28T23:31:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.233067ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14422024-08-28T23:31:52.094ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14432024-08-28T23:31:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.191906ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14442024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
14452024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.548571ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
14462024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14472024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14482024-08-28T23:31:52.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1260, tv_nsec: 877150199 } })
14492024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14502024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14512024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14522024-08-28T23:31:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14532024-08-28T23:31:52.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14542024-08-28T23:31:52.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14552024-08-28T23:31:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14562024-08-28T23:31:52.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
14572024-08-28T23:31:52.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14582024-08-28T23:31:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14592024-08-28T23:31:52.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602024-08-28T23:31:52.102ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:21:52.091862765 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14612024-08-28T23:31:52.102ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.020501ms iteration = 5 status = {"expiration":"2024-08-28T23:21:52.091862765Z","pruned":[]}
14622024-08-28T23:31:52.103ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.711423ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
14632024-08-28T23:31:52.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14642024-08-28T23:31:52.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14652024-08-28T23:31:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14662024-08-28T23:31:52.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14672024-08-28T23:31:52.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14682024-08-28T23:31:52.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14692024-08-28T23:31:52.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14702024-08-28T23:31:52.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14712024-08-28T23:31:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14722024-08-28T23:31:52.133ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732024-08-28T23:31:52.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14742024-08-28T23:31:52.136ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14752024-08-28T23:31:52.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14762024-08-28T23:31:52.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14772024-08-28T23:31:52.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14782024-08-28T23:31:52.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14792024-08-28T23:31:52.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14802024-08-28T23:31:52.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-08-28T23:31:52.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.89085ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
14822024-08-28T23:31:52.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
14832024-08-28T23:31:52.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14842024-08-28T23:31:52.148ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
14852024-08-28T23:31:52.148ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
14862024-08-28T23:31:52.148ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.228055ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
14872024-08-28T23:31:52.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14882024-08-28T23:31:52.149ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14892024-08-28T23:31:52.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14902024-08-28T23:31:52.152ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-08-28T23:31:52.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-08-28T23:31:52.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14942024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14952024-08-28T23:31:52.153ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14962024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14972024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14982024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14992024-08-28T23:31:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15002024-08-28T23:31:52.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15012024-08-28T23:31:52.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15022024-08-28T23:31:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15032024-08-28T23:31:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15042024-08-28T23:31:52.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15052024-08-28T23:31:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15062024-08-28T23:31:52.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15072024-08-28T23:31:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15082024-08-28T23:31:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15092024-08-28T23:31:52.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15102024-08-28T23:31:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15112024-08-28T23:31:52.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15122024-08-28T23:31:52.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15132024-08-28T23:31:52.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142024-08-28T23:31:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15152024-08-28T23:31:52.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15162024-08-28T23:31:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15172024-08-28T23:31:52.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1260, tv_nsec: 942669113 } })
15182024-08-28T23:31:52.162ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
15192024-08-28T23:31:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15202024-08-28T23:31:52.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15212024-08-28T23:31:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15222024-08-28T23:31:52.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15232024-08-28T23:31:52.166ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
15242024-08-28T23:31:52.166ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.084456ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
15252024-08-28T23:31:52.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262024-08-28T23:31:52.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15272024-08-28T23:31:52.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15282024-08-28T23:31:52.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15292024-08-28T23:31:52.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15302024-08-28T23:31:52.198ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15312024-08-28T23:31:52.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15322024-08-28T23:31:52.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15332024-08-28T23:31:52.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15342024-08-28T23:31:52.202ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
15352024-08-28T23:31:52.202ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15362024-08-28T23:31:52.202ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.850449ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
15372024-08-28T23:31:52.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15382024-08-28T23:31:52.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15392024-08-28T23:31:52.205ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1260, tv_nsec: 986320088 } })
15402024-08-28T23:31:52.205ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15412024-08-28T23:31:52.205ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15422024-08-28T23:31:52.205ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15432024-08-28T23:31:52.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15442024-08-28T23:31:52.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15452024-08-28T23:31:52.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.478025ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
15462024-08-28T23:31:52.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-08-28T23:31:52.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
15482024-08-28T23:31:52.208ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15492024-08-28T23:31:52.208ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15502024-08-28T23:31:52.208ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.432952ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15512024-08-28T23:31:52.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15522024-08-28T23:31:52.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15532024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15542024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15552024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15562024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15572024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
15582024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15592024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15602024-08-28T23:31:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15612024-08-28T23:31:52.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.178355ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15622024-08-28T23:31:52.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.468389ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15632024-08-28T23:31:52.217ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.529756ms iteration = 9 status = 0
15642024-08-28T23:31:52.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15652024-08-28T23:31:52.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15662024-08-28T23:31:52.247ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15672024-08-28T23:31:52.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf572202-0f81-49eb-b820-77cfc96985bc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
15682024-08-28T23:31:52.250ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
15692024-08-28T23:31:52.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.17065ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15702024-08-28T23:31:52.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf572202-0f81-49eb-b820-77cfc96985bc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
15712024-08-28T23:31:52.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf572202-0f81-49eb-b820-77cfc96985bc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
15722024-08-28T23:31:52.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-08-28T23:31:52.261ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15742024-08-28T23:31:52.261ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 169.61497ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15752024-08-28T23:31:52.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15762024-08-28T23:31:52.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15772024-08-28T23:31:52.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15782024-08-28T23:31:52.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-08-28T23:31:52.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802024-08-28T23:31:52.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15812024-08-28T23:31:52.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15822024-08-28T23:31:52.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15832024-08-28T23:31:52.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15842024-08-28T23:31:52.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15852024-08-28T23:31:52.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15862024-08-28T23:31:52.276ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15872024-08-28T23:31:52.276ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15882024-08-28T23:31:52.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15892024-08-28T23:31:52.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15902024-08-28T23:31:52.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15912024-08-28T23:31:52.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15922024-08-28T23:31:52.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15932024-08-28T23:31:52.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15942024-08-28T23:31:52.290ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
15952024-08-28T23:31:52.290ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15962024-08-28T23:31:52.290ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
15972024-08-28T23:31:52.290ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 199.937433ms iteration = 5 status = {"generation":1}
15982024-08-28T23:31:52.300ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.64751ms iteration = 11 status = {"physical_disks_added":0}
15992024-08-28T23:31:52.302ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16002024-08-28T23:31:52.302ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
16012024-08-28T23:31:52.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16022024-08-28T23:31:52.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16032024-08-28T23:31:52.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16042024-08-28T23:31:52.318ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16052024-08-28T23:31:52.318ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0632f89-78db-40b2-8c8b-f3e258fdd342", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16062024-08-28T23:31:52.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16072024-08-28T23:31:52.321ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16082024-08-28T23:31:52.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16092024-08-28T23:31:52.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
16102024-08-28T23:31:52.346ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16112024-08-28T23:31:52.347ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b30b01d3-f548-4be5-9e1c-fc909605b3bf", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16122024-08-28T23:31:52.347ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16132024-08-28T23:31:52.349ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
16142024-08-28T23:31:52.351ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
16152024-08-28T23:31:52.351ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 261.005296ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16162024-08-28T23:31:52.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-08-28T23:31:52.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16182024-08-28T23:31:52.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16192024-08-28T23:31:52.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16202024-08-28T23:31:52.363ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
16212024-08-28T23:31:52.363ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16222024-08-28T23:31:52.363ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
16232024-08-28T23:31:52.363ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 273.039104ms iteration = 5 status = {"generation":2}
16242024-08-28T23:31:52.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16252024-08-28T23:31:52.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16262024-08-28T23:31:52.397ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16272024-08-28T23:31:52.397ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16282024-08-28T23:31:52.398ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf383e2-b651-4079-9521-826074946bfb", "content-length": "26", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16292024-08-28T23:31:52.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16302024-08-28T23:31:52.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16312024-08-28T23:31:52.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16322024-08-28T23:31:52.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16332024-08-28T23:31:52.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16342024-08-28T23:31:52.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16352024-08-28T23:31:52.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362024-08-28T23:31:52.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16372024-08-28T23:31:52.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16382024-08-28T23:31:52.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16392024-08-28T23:31:52.431ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16402024-08-28T23:31:52.431ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "37e94ca2-88a6-4387-8dbb-b2a519f6770b", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16412024-08-28T23:31:52.431ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16422024-08-28T23:31:52.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc0947f3-8853-4ec0-b73e-18d24d292519", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16432024-08-28T23:31:52.434ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16442024-08-28T23:31:52.436ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16452024-08-28T23:31:52.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 346.266298ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16462024-08-28T23:31:52.479ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.837704ms iteration = 9 status = {}
16472024-08-28T23:31:52.486ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16482024-08-28T23:31:52.488ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc62837-5e5f-413b-9881-3ff1ca5f017f", "content-length": "372", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16492024-08-28T23:31:52.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16502024-08-28T23:31:52.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16512024-08-28T23:31:52.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16522024-08-28T23:31:52.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16532024-08-28T23:31:52.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16542024-08-28T23:31:52.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16552024-08-28T23:31:52.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16562024-08-28T23:31:52.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6afc776e-ea34-462d-b3e9-52fba139e8bc", "content-length": "691", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16572024-08-28T23:31:52.565ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16582024-08-28T23:31:52.565ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16592024-08-28T23:31:52.565ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16602024-08-28T23:31:52.567ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 476.083984ms iteration = 9 status = {}
16612024-08-28T23:31:52.571ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16622024-08-28T23:31:52.571ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c0aac94b-a7dd-4042-b035-6c3eb54827f7", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16632024-08-28T23:31:52.573ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.416411ms iteration = 9 status = {}
16642024-08-28T23:31:52.588ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16652024-08-28T23:31:52.636ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16662024-08-28T23:31:52.637ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6669117a-f1f7-4941-ba1e-ebd6c29bc24f", "content-length": "1", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16672024-08-28T23:31:52.639ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16682024-08-28T23:31:52.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16692024-08-28T23:31:52.641ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 550.697183ms iteration = 9 status = null
16702024-08-28T23:31:52.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16712024-08-28T23:31:52.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "00e07c16-e045-4e39-8f8a-7533fc2f28e6", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16722024-08-28T23:31:52.682ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16732024-08-28T23:31:52.684ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3af321be-6b84-4851-ba0a-66a50bf60e8f", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16742024-08-28T23:31:52.684ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16752024-08-28T23:31:52.686ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a54fd81f-7986-46a0-8a5b-13b291338595", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16762024-08-28T23:31:52.686ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16772024-08-28T23:31:52.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16782024-08-28T23:31:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16792024-08-28T23:31:52.688ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16802024-08-28T23:31:52.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 598.28803ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16812024-08-28T23:31:52.689ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
16822024-08-28T23:31:52.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16832024-08-28T23:31:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16842024-08-28T23:31:52.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16852024-08-28T23:31:52.698ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3fe3b246-482f-49f1-8eac-43906f21dcf8", "content-length": "121", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16862024-08-28T23:31:52.698ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16872024-08-28T23:31:52.698ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
16882024-08-28T23:31:52.699ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16892024-08-28T23:31:52.699ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16902024-08-28T23:31:52.699ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
16912024-08-28T23:31:52.699ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
16922024-08-28T23:31:52.699ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
16932024-08-28T23:31:52.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16942024-08-28T23:31:52.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16952024-08-28T23:31:52.701ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16962024-08-28T23:31:52.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5758165a-7c29-45fb-a921-ade6eb3a9f69", "content-length": "2", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16972024-08-28T23:31:52.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16982024-08-28T23:31:52.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f60d11ed-93ff-4a2a-8d65-9f5a64776672", "content-length": "52", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
16992024-08-28T23:31:52.702ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
17002024-08-28T23:31:52.702ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17012024-08-28T23:31:52.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8acd387d-0e21-4ba9-b6ec-d12bb97e3eb5", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
17022024-08-28T23:31:52.796ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
17032024-08-28T23:31:52.796ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17042024-08-28T23:31:52.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3c0186-a4da-4d95-8026-06d4784b8c28", "content-length": "667", "date": "Wed, 28 Aug 2024 23:31:52 GMT"} })
17052024-08-28T23:31:52.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17062024-08-28T23:31:52.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17072024-08-28T23:31:52.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17082024-08-28T23:31:52.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17092024-08-28T23:31:52.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17102024-08-28T23:31:52.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17112024-08-28T23:31:52.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17122024-08-28T23:31:52.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17132024-08-28T23:31:52.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 382 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = cd20c95b-c4fc-4916-8bc9-db846ef72267 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
17142024-08-28T23:31:52.817ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 725.07155ms iteration = 9 status = {}
17152024-08-28T23:31:53.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b2a03f-db06-40c9-891c-f174632dbc3a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17162024-08-28T23:31:53.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b2a03f-db06-40c9-891c-f174632dbc3a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17172024-08-28T23:31:53.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b2a03f-db06-40c9-891c-f174632dbc3a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17182024-08-28T23:31:54.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97398734-6e05-4488-b2de-7264c301107b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17192024-08-28T23:31:54.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97398734-6e05-4488-b2de-7264c301107b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17202024-08-28T23:31:54.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97398734-6e05-4488-b2de-7264c301107b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17212024-08-28T23:31:55.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c211995-2bcd-4cbf-a0db-d11f3eb678d5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17222024-08-28T23:31:55.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c211995-2bcd-4cbf-a0db-d11f3eb678d5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17232024-08-28T23:31:55.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c211995-2bcd-4cbf-a0db-d11f3eb678d5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17242024-08-28T23:31:56.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7ef4a09-5e5e-4f01-8afb-8941a6d691e6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17252024-08-28T23:31:56.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7ef4a09-5e5e-4f01-8afb-8941a6d691e6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17262024-08-28T23:31:56.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7ef4a09-5e5e-4f01-8afb-8941a6d691e6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17272024-08-28T23:31:57.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 07c72094-ee5d-48f9-859c-a2e4dab26544 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17282024-08-28T23:31:57.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 07c72094-ee5d-48f9-859c-a2e4dab26544 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17292024-08-28T23:31:57.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 07c72094-ee5d-48f9-859c-a2e4dab26544 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17302024-08-28T23:31:58.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5829653-b248-40ea-905b-02a719184810 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17312024-08-28T23:31:58.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5829653-b248-40ea-905b-02a719184810 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17322024-08-28T23:31:58.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5829653-b248-40ea-905b-02a719184810 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17332024-08-28T23:31:59.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3108b26-42b6-4975-a9c1-a01788759323 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17342024-08-28T23:31:59.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3108b26-42b6-4975-a9c1-a01788759323 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17352024-08-28T23:31:59.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3108b26-42b6-4975-a9c1-a01788759323 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17362024-08-28T23:32:00.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6a5cc88-87fe-4ab1-aa8c-5d61713da994 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17372024-08-28T23:32:00.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6a5cc88-87fe-4ab1-aa8c-5d61713da994 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17382024-08-28T23:32:00.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6a5cc88-87fe-4ab1-aa8c-5d61713da994 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17392024-08-28T23:32:01.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b584848-5d9c-4add-9879-fe8761d892eb roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17402024-08-28T23:32:01.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b584848-5d9c-4add-9879-fe8761d892eb resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17412024-08-28T23:32:01.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3b584848-5d9c-4add-9879-fe8761d892eb response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17422024-08-28T23:32:02.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
17432024-08-28T23:32:02.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17442024-08-28T23:32:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17452024-08-28T23:32:02.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
17462024-08-28T23:32:02.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17472024-08-28T23:32:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17482024-08-28T23:32:02.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492024-08-28T23:32:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17502024-08-28T23:32:02.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17512024-08-28T23:32:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17522024-08-28T23:32:02.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17532024-08-28T23:32:02.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17542024-08-28T23:32:02.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552024-08-28T23:32:02.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
17562024-08-28T23:32:02.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17572024-08-28T23:32:02.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17582024-08-28T23:32:02.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
17592024-08-28T23:32:02.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.548626ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
17602024-08-28T23:32:02.118ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17612024-08-28T23:32:02.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17622024-08-28T23:32:02.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.002348ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17632024-08-28T23:32:02.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6137f607-e98a-4915-aab3-60e0a3e72746 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17642024-08-28T23:32:02.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6137f607-e98a-4915-aab3-60e0a3e72746 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17652024-08-28T23:32:02.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6137f607-e98a-4915-aab3-60e0a3e72746 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17662024-08-28T23:32:02.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 420 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = e0d521d4-d26a-4cd1-a4d1-0bdd9044bc5d response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
17672024-08-28T23:32:03.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68a53c73-d63e-4363-9b38-be1e3f5bb211 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17682024-08-28T23:32:03.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68a53c73-d63e-4363-9b38-be1e3f5bb211 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17692024-08-28T23:32:03.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68a53c73-d63e-4363-9b38-be1e3f5bb211 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17702024-08-28T23:32:04.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68697375-ce52-48fe-819e-3b4bb43a7636 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17712024-08-28T23:32:04.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68697375-ce52-48fe-819e-3b4bb43a7636 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17722024-08-28T23:32:04.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 68697375-ce52-48fe-819e-3b4bb43a7636 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17732024-08-28T23:32:05.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d63bb7-1378-4981-9de2-2f4d764d9e6d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17742024-08-28T23:32:05.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d63bb7-1378-4981-9de2-2f4d764d9e6d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17752024-08-28T23:32:05.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d63bb7-1378-4981-9de2-2f4d764d9e6d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17762024-08-28T23:32:06.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ff7940-9c3e-456f-83ee-aa2b28d85fd0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17772024-08-28T23:32:06.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ff7940-9c3e-456f-83ee-aa2b28d85fd0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17782024-08-28T23:32:06.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ff7940-9c3e-456f-83ee-aa2b28d85fd0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17792024-08-28T23:32:07.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4bcfa85-b6cc-4558-b1e4-0c30b9516da2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17802024-08-28T23:32:07.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4bcfa85-b6cc-4558-b1e4-0c30b9516da2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17812024-08-28T23:32:07.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4bcfa85-b6cc-4558-b1e4-0c30b9516da2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17822024-08-28T23:32:08.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af30a281-ca13-4473-a1dc-9de55be0096f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17832024-08-28T23:32:08.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af30a281-ca13-4473-a1dc-9de55be0096f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17842024-08-28T23:32:08.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af30a281-ca13-4473-a1dc-9de55be0096f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17852024-08-28T23:32:09.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9ac2224e-c713-4332-beec-9ba4f4266ec7 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17862024-08-28T23:32:09.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9ac2224e-c713-4332-beec-9ba4f4266ec7 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17872024-08-28T23:32:09.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9ac2224e-c713-4332-beec-9ba4f4266ec7 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17882024-08-28T23:32:10.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 19639a31-db99-49b8-a0e0-417024014a5d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17892024-08-28T23:32:10.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 19639a31-db99-49b8-a0e0-417024014a5d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17902024-08-28T23:32:10.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 19639a31-db99-49b8-a0e0-417024014a5d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17912024-08-28T23:32:11.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55e80aee-8018-4039-b512-5507313aa687 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17922024-08-28T23:32:11.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55e80aee-8018-4039-b512-5507313aa687 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17932024-08-28T23:32:11.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55e80aee-8018-4039-b512-5507313aa687 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
17942024-08-28T23:32:12.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
17952024-08-28T23:32:12.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-08-28T23:32:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-08-28T23:32:12.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
17982024-08-28T23:32:12.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17992024-08-28T23:32:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18002024-08-28T23:32:12.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-08-28T23:32:12.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18022024-08-28T23:32:12.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18032024-08-28T23:32:12.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18042024-08-28T23:32:12.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18052024-08-28T23:32:12.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062024-08-28T23:32:12.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18072024-08-28T23:32:12.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-08-28T23:32:12.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092024-08-28T23:32:12.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
18102024-08-28T23:32:12.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18112024-08-28T23:32:12.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18122024-08-28T23:32:12.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
18132024-08-28T23:32:12.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.3881ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
18142024-08-28T23:32:12.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.744673ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18152024-08-28T23:32:12.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b426ff4d-a7cd-41b2-9420-764567af5c58 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18162024-08-28T23:32:12.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b426ff4d-a7cd-41b2-9420-764567af5c58 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18172024-08-28T23:32:12.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b426ff4d-a7cd-41b2-9420-764567af5c58 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18182024-08-28T23:32:12.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 472 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 799cbaf9-12b0-47ed-9110-2fdb36153d36 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
18192024-08-28T23:32:13.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74afe8e9-78a4-4148-9bc6-8b8a29eab38f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18202024-08-28T23:32:13.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74afe8e9-78a4-4148-9bc6-8b8a29eab38f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18212024-08-28T23:32:13.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74afe8e9-78a4-4148-9bc6-8b8a29eab38f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18222024-08-28T23:32:14.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5a4ab7-5b87-4e5a-b8c3-2a9619658043 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18232024-08-28T23:32:14.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5a4ab7-5b87-4e5a-b8c3-2a9619658043 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18242024-08-28T23:32:14.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5a4ab7-5b87-4e5a-b8c3-2a9619658043 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18252024-08-28T23:32:15.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f1a33a06-3241-4f61-885e-67db8f8f8e78 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18262024-08-28T23:32:15.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f1a33a06-3241-4f61-885e-67db8f8f8e78 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18272024-08-28T23:32:15.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f1a33a06-3241-4f61-885e-67db8f8f8e78 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18282024-08-28T23:32:16.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8be7e8f-2055-4332-b843-49e31383fcc2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18292024-08-28T23:32:16.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8be7e8f-2055-4332-b843-49e31383fcc2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18302024-08-28T23:32:16.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8be7e8f-2055-4332-b843-49e31383fcc2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18312024-08-28T23:32:17.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaaf1eb0-61ca-4f0f-baee-213e9ed93097 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18322024-08-28T23:32:17.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaaf1eb0-61ca-4f0f-baee-213e9ed93097 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18332024-08-28T23:32:17.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaaf1eb0-61ca-4f0f-baee-213e9ed93097 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18342024-08-28T23:32:18.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 631e29a9-ad17-4501-8606-5b3494c74d64 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18352024-08-28T23:32:18.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 631e29a9-ad17-4501-8606-5b3494c74d64 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18362024-08-28T23:32:18.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 631e29a9-ad17-4501-8606-5b3494c74d64 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18372024-08-28T23:32:19.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c257f6f-28ce-47a0-873a-9d9479bdba0c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18382024-08-28T23:32:19.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c257f6f-28ce-47a0-873a-9d9479bdba0c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18392024-08-28T23:32:19.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c257f6f-28ce-47a0-873a-9d9479bdba0c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18402024-08-28T23:32:20.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8921b8d-23c1-40f0-afeb-e35c4edddc46 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18412024-08-28T23:32:20.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8921b8d-23c1-40f0-afeb-e35c4edddc46 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18422024-08-28T23:32:20.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8921b8d-23c1-40f0-afeb-e35c4edddc46 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18432024-08-28T23:32:21.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3e3a33c3-c067-4e3b-9258-ed25f36413c5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18442024-08-28T23:32:21.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3e3a33c3-c067-4e3b-9258-ed25f36413c5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18452024-08-28T23:32:21.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3e3a33c3-c067-4e3b-9258-ed25f36413c5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
18462024-08-28T23:32:22.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
18472024-08-28T23:32:22.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
18482024-08-28T23:32:22.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
18492024-08-28T23:32:22.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18502024-08-28T23:32:22.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
18512024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18522024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18532024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
18542024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18552024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18562024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18572024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582024-08-28T23:32:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18592024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
18602024-08-28T23:32:22.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
18612024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
18622024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18632024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
18642024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18652024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18662024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18672024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
18682024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18692024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
18702024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18712024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
18722024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18732024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
18742024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
18752024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18762024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18772024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
18782024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18792024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
18802024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18812024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
18822024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18832024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18842024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18852024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18862024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18872024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18882024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18892024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18902024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18912024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18922024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18932024-08-28T23:32:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18942024-08-28T23:32:22.092ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952024-08-28T23:32:22.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-08-28T23:32:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1290, tv_nsec: 875147833 } })
18972024-08-28T23:32:22.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18982024-08-28T23:32:22.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18992024-08-28T23:32:22.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19002024-08-28T23:32:22.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
19012024-08-28T23:32:22.095ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.339057ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19022024-08-28T23:32:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1290, tv_nsec: 876659630 } })
19032024-08-28T23:32:22.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-08-28T23:32:22.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
19052024-08-28T23:32:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19062024-08-28T23:32:22.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19072024-08-28T23:32:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082024-08-28T23:32:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19092024-08-28T23:32:22.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19102024-08-28T23:32:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19112024-08-28T23:32:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19122024-08-28T23:32:22.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19132024-08-28T23:32:22.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19142024-08-28T23:32:22.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19152024-08-28T23:32:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162024-08-28T23:32:22.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19172024-08-28T23:32:22.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19182024-08-28T23:32:22.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19192024-08-28T23:32:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19202024-08-28T23:32:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19212024-08-28T23:32:22.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19222024-08-28T23:32:22.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19232024-08-28T23:32:22.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19242024-08-28T23:32:22.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19252024-08-28T23:32:22.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19262024-08-28T23:32:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19272024-08-28T23:32:22.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19282024-08-28T23:32:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19292024-08-28T23:32:22.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19302024-08-28T23:32:22.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19312024-08-28T23:32:22.139ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19322024-08-28T23:32:22.139ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19332024-08-28T23:32:22.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19342024-08-28T23:32:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19352024-08-28T23:32:22.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.685905ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
19362024-08-28T23:32:22.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19372024-08-28T23:32:22.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19382024-08-28T23:32:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19392024-08-28T23:32:22.144ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19402024-08-28T23:32:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19412024-08-28T23:32:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19422024-08-28T23:32:22.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19432024-08-28T23:32:22.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19442024-08-28T23:32:22.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.265365ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
19452024-08-28T23:32:22.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462024-08-28T23:32:22.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19472024-08-28T23:32:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19482024-08-28T23:32:22.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19492024-08-28T23:32:22.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19502024-08-28T23:32:22.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19512024-08-28T23:32:22.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19522024-08-28T23:32:22.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19532024-08-28T23:32:22.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542024-08-28T23:32:22.154ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1290, tv_nsec: 935322819 } })
19552024-08-28T23:32:22.154ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
19562024-08-28T23:32:22.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
19572024-08-28T23:32:22.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19582024-08-28T23:32:22.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19592024-08-28T23:32:22.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602024-08-28T23:32:22.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19612024-08-28T23:32:22.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19622024-08-28T23:32:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19632024-08-28T23:32:22.167ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19642024-08-28T23:32:22.167ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19652024-08-28T23:32:22.167ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
19662024-08-28T23:32:22.167ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.980841ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
19672024-08-28T23:32:22.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.459742ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19682024-08-28T23:32:22.169ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "89e545c4-424a-4e3e-96d9-5b826192104c", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
19692024-08-28T23:32:22.169ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19702024-08-28T23:32:22.171ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19712024-08-28T23:32:22.182ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19722024-08-28T23:32:22.182ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19732024-08-28T23:32:22.182ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.824084ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
19742024-08-28T23:32:22.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19752024-08-28T23:32:22.184ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19762024-08-28T23:32:22.184ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0898cc8c-5b31-4828-a47f-ab0696cdc6f7", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
19772024-08-28T23:32:22.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19782024-08-28T23:32:22.185ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19792024-08-28T23:32:22.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.706106ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19802024-08-28T23:32:22.185ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
19812024-08-28T23:32:22.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.767987ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19822024-08-28T23:32:22.186ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19832024-08-28T23:32:22.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.133064ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19842024-08-28T23:32:22.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19852024-08-28T23:32:22.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
19862024-08-28T23:32:22.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19872024-08-28T23:32:22.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19882024-08-28T23:32:22.197ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.298686ms iteration = 10 status = 0
19892024-08-28T23:32:22.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19902024-08-28T23:32:22.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19912024-08-28T23:32:22.236ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 146.144432ms iteration = 12 status = {"physical_disks_added":0}
19922024-08-28T23:32:22.240ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
19932024-08-28T23:32:22.241ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19942024-08-28T23:32:22.241ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "309c9964-0add-4846-8911-03c2d27834f8", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
19952024-08-28T23:32:22.241ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19962024-08-28T23:32:22.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
19972024-08-28T23:32:22.267ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19982024-08-28T23:32:22.267ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d205b61-9837-46ba-97f8-219b9f251c13", "content-length": "1", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
19992024-08-28T23:32:22.269ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20002024-08-28T23:32:22.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20012024-08-28T23:32:22.285ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.290708ms iteration = 10 status = {}
20022024-08-28T23:32:22.317ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20032024-08-28T23:32:22.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20042024-08-28T23:32:22.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20052024-08-28T23:32:22.319ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.4728ms iteration = 10 status = null
20062024-08-28T23:32:22.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072024-08-28T23:32:22.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20082024-08-28T23:32:22.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20092024-08-28T23:32:22.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20102024-08-28T23:32:22.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20112024-08-28T23:32:22.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20122024-08-28T23:32:22.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20132024-08-28T23:32:22.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20142024-08-28T23:32:22.396ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20152024-08-28T23:32:22.416ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8997b7e5-1850-492c-ba03-dc72e5f7f1a2", "content-length": "372", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20162024-08-28T23:32:22.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20172024-08-28T23:32:22.416ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "479a5185-6c35-4b4e-9ecd-adc63b6efc96", "content-length": "691", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20182024-08-28T23:32:22.416ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20192024-08-28T23:32:22.416ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20202024-08-28T23:32:22.416ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20212024-08-28T23:32:22.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20222024-08-28T23:32:22.417ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 326.787343ms iteration = 10 status = {}
20232024-08-28T23:32:22.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20242024-08-28T23:32:22.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20252024-08-28T23:32:22.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20262024-08-28T23:32:22.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20272024-08-28T23:32:22.422ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
20282024-08-28T23:32:22.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20292024-08-28T23:32:22.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20302024-08-28T23:32:22.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20312024-08-28T23:32:22.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20322024-08-28T23:32:22.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20332024-08-28T23:32:22.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "494d9775-0852-46d8-af59-c4823e1b3068", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20342024-08-28T23:32:22.428ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.273145ms iteration = 10 status = {}
20352024-08-28T23:32:22.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20362024-08-28T23:32:22.529ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e02bc086-08fd-4bb3-962d-51084ed7d8e9", "content-length": "121", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20372024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20382024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
20392024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20402024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20412024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
20422024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
20432024-08-28T23:32:22.529ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
20442024-08-28T23:32:22.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20452024-08-28T23:32:22.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20462024-08-28T23:32:22.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20472024-08-28T23:32:22.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8abfb504-f1eb-414c-8a8d-b4abce6bc84e", "content-length": "2", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20482024-08-28T23:32:22.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20492024-08-28T23:32:22.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10c86dda-b7ed-435d-9010-6e90fef019f2", "content-length": "52", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20502024-08-28T23:32:22.532ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
20512024-08-28T23:32:22.532ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20522024-08-28T23:32:22.631ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d353f62b-8087-4b3b-8310-29a01cad1f37", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20532024-08-28T23:32:22.631ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
20542024-08-28T23:32:22.631ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20552024-08-28T23:32:22.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4be8f0a-2206-4e32-9949-2f19e55878ab", "content-length": "667", "date": "Wed, 28 Aug 2024 23:32:22 GMT"} })
20562024-08-28T23:32:22.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20572024-08-28T23:32:22.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20582024-08-28T23:32:22.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20592024-08-28T23:32:22.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20602024-08-28T23:32:22.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20612024-08-28T23:32:22.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20622024-08-28T23:32:22.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20632024-08-28T23:32:22.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20642024-08-28T23:32:22.750ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 659.691189ms iteration = 10 status = {}
20652024-08-28T23:32:22.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 455 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = cdb82dc4-3bce-4e90-a47a-f6c736f3698b response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
20662024-08-28T23:32:22.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 360db72d-0bf0-4312-822d-c0d3bf79d3e5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20672024-08-28T23:32:22.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 360db72d-0bf0-4312-822d-c0d3bf79d3e5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20682024-08-28T23:32:22.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 360db72d-0bf0-4312-822d-c0d3bf79d3e5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20692024-08-28T23:32:23.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 91af25c5-5a15-42aa-86fb-ad470da0006d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20702024-08-28T23:32:23.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 91af25c5-5a15-42aa-86fb-ad470da0006d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20712024-08-28T23:32:23.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 91af25c5-5a15-42aa-86fb-ad470da0006d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20722024-08-28T23:32:24.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 287cb87d-b858-4593-8429-b32d4af26f75 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20732024-08-28T23:32:24.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 287cb87d-b858-4593-8429-b32d4af26f75 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20742024-08-28T23:32:24.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 287cb87d-b858-4593-8429-b32d4af26f75 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20752024-08-28T23:32:25.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6aade544-75cd-4600-a663-38cf55dac7e0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20762024-08-28T23:32:25.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6aade544-75cd-4600-a663-38cf55dac7e0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20772024-08-28T23:32:25.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6aade544-75cd-4600-a663-38cf55dac7e0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20782024-08-28T23:32:27.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2a61b89-b865-4737-9aec-2737e9d1f1c0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20792024-08-28T23:32:27.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2a61b89-b865-4737-9aec-2737e9d1f1c0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20802024-08-28T23:32:27.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c2a61b89-b865-4737-9aec-2737e9d1f1c0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20812024-08-28T23:32:28.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2b644fd3-dd3a-42c6-a352-279870fe26d1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20822024-08-28T23:32:28.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2b644fd3-dd3a-42c6-a352-279870fe26d1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20832024-08-28T23:32:28.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2b644fd3-dd3a-42c6-a352-279870fe26d1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20842024-08-28T23:32:29.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18b7142a-fb71-421c-908f-a01b31c8c266 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20852024-08-28T23:32:29.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18b7142a-fb71-421c-908f-a01b31c8c266 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20862024-08-28T23:32:29.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18b7142a-fb71-421c-908f-a01b31c8c266 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20872024-08-28T23:32:30.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 913a984c-a7e2-4d88-a828-b2194c17366e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20882024-08-28T23:32:30.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 913a984c-a7e2-4d88-a828-b2194c17366e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20892024-08-28T23:32:30.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 913a984c-a7e2-4d88-a828-b2194c17366e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20902024-08-28T23:32:31.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a31d1e43-a4d8-4b06-9e13-fa9e3b66abf4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20912024-08-28T23:32:31.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a31d1e43-a4d8-4b06-9e13-fa9e3b66abf4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20922024-08-28T23:32:31.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a31d1e43-a4d8-4b06-9e13-fa9e3b66abf4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
20932024-08-28T23:32:32.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
20942024-08-28T23:32:32.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20952024-08-28T23:32:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20962024-08-28T23:32:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
20972024-08-28T23:32:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20982024-08-28T23:32:32.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20992024-08-28T23:32:32.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002024-08-28T23:32:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21012024-08-28T23:32:32.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21022024-08-28T23:32:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032024-08-28T23:32:32.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21042024-08-28T23:32:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21052024-08-28T23:32:32.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21062024-08-28T23:32:32.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
21072024-08-28T23:32:32.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21082024-08-28T23:32:32.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21092024-08-28T23:32:32.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
21102024-08-28T23:32:32.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.533803ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
21112024-08-28T23:32:32.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c83506ad-1fa5-4e9a-bb10-c322ab751c5b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21122024-08-28T23:32:32.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c83506ad-1fa5-4e9a-bb10-c322ab751c5b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21132024-08-28T23:32:32.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c83506ad-1fa5-4e9a-bb10-c322ab751c5b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21142024-08-28T23:32:32.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21152024-08-28T23:32:32.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21162024-08-28T23:32:32.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.660418ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21172024-08-28T23:32:32.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 688 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = b28e3fdd-10d6-481e-9763-27d1d9dcf011 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
21182024-08-28T23:32:33.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b0c3be59-ce75-4de7-ad40-ade8438e9732 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21192024-08-28T23:32:33.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b0c3be59-ce75-4de7-ad40-ade8438e9732 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21202024-08-28T23:32:33.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b0c3be59-ce75-4de7-ad40-ade8438e9732 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21212024-08-28T23:32:34.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcd2addc-ab63-43af-9143-05bb3e496d3d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21222024-08-28T23:32:34.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcd2addc-ab63-43af-9143-05bb3e496d3d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21232024-08-28T23:32:34.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcd2addc-ab63-43af-9143-05bb3e496d3d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21242024-08-28T23:32:35.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 715394f9-e0ac-49a4-b459-027e5d94824c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21252024-08-28T23:32:35.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 715394f9-e0ac-49a4-b459-027e5d94824c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21262024-08-28T23:32:35.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 715394f9-e0ac-49a4-b459-027e5d94824c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21272024-08-28T23:32:36.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f612fc11-e271-4d70-b90e-e0597549063c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21282024-08-28T23:32:36.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f612fc11-e271-4d70-b90e-e0597549063c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21292024-08-28T23:32:36.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f612fc11-e271-4d70-b90e-e0597549063c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21302024-08-28T23:32:37.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5012334b-5b24-4fde-9606-f478697205c5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21312024-08-28T23:32:37.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5012334b-5b24-4fde-9606-f478697205c5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21322024-08-28T23:32:37.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5012334b-5b24-4fde-9606-f478697205c5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21332024-08-28T23:32:38.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b2dabea-3dd7-4332-b12a-48d80ba5e373 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21342024-08-28T23:32:38.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b2dabea-3dd7-4332-b12a-48d80ba5e373 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21352024-08-28T23:32:38.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b2dabea-3dd7-4332-b12a-48d80ba5e373 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21362024-08-28T23:32:39.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = edde0e41-3880-467e-872c-40ca7d3b305a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21372024-08-28T23:32:39.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = edde0e41-3880-467e-872c-40ca7d3b305a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21382024-08-28T23:32:39.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = edde0e41-3880-467e-872c-40ca7d3b305a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21392024-08-28T23:32:40.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cdc3cca-ffd7-49a9-8519-43e4ab624a26 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21402024-08-28T23:32:40.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cdc3cca-ffd7-49a9-8519-43e4ab624a26 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21412024-08-28T23:32:40.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cdc3cca-ffd7-49a9-8519-43e4ab624a26 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21422024-08-28T23:32:41.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0341b1b-8051-4e7b-b08c-4fb260d93665 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21432024-08-28T23:32:41.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0341b1b-8051-4e7b-b08c-4fb260d93665 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21442024-08-28T23:32:41.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0341b1b-8051-4e7b-b08c-4fb260d93665 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21452024-08-28T23:32:42.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
21462024-08-28T23:32:42.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21472024-08-28T23:32:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482024-08-28T23:32:42.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
21492024-08-28T23:32:42.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21502024-08-28T23:32:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21512024-08-28T23:32:42.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21522024-08-28T23:32:42.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21532024-08-28T23:32:42.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21542024-08-28T23:32:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21552024-08-28T23:32:42.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21562024-08-28T23:32:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21572024-08-28T23:32:42.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582024-08-28T23:32:42.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592024-08-28T23:32:42.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602024-08-28T23:32:42.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
21612024-08-28T23:32:42.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21622024-08-28T23:32:42.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21632024-08-28T23:32:42.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
21642024-08-28T23:32:42.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.56772ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
21652024-08-28T23:32:42.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.806364ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21662024-08-28T23:32:42.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6f2db605-22e5-44f7-90e1-2fa7fc58753b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21672024-08-28T23:32:42.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6f2db605-22e5-44f7-90e1-2fa7fc58753b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21682024-08-28T23:32:42.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6f2db605-22e5-44f7-90e1-2fa7fc58753b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21692024-08-28T23:32:42.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 7c577924-9d9c-4808-b4ad-263c953196ba response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
21702024-08-28T23:32:43.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 059c0935-338c-44ed-8366-ccf932922d5b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21712024-08-28T23:32:43.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 059c0935-338c-44ed-8366-ccf932922d5b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21722024-08-28T23:32:43.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 059c0935-338c-44ed-8366-ccf932922d5b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21732024-08-28T23:32:44.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 556e4372-3a10-406f-82b7-a2eba5ffc997 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21742024-08-28T23:32:44.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 556e4372-3a10-406f-82b7-a2eba5ffc997 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21752024-08-28T23:32:44.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 556e4372-3a10-406f-82b7-a2eba5ffc997 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21762024-08-28T23:32:45.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f197dff8-e991-4e46-902e-8cce3b4f7ae4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21772024-08-28T23:32:45.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f197dff8-e991-4e46-902e-8cce3b4f7ae4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21782024-08-28T23:32:45.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f197dff8-e991-4e46-902e-8cce3b4f7ae4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21792024-08-28T23:32:46.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ec3a7d3f-bd97-4e14-9c41-e85493f5335f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21802024-08-28T23:32:46.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ec3a7d3f-bd97-4e14-9c41-e85493f5335f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21812024-08-28T23:32:46.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ec3a7d3f-bd97-4e14-9c41-e85493f5335f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21822024-08-28T23:32:47.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf074aff-cfe5-4fba-b69a-b199c0217bb0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21832024-08-28T23:32:47.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf074aff-cfe5-4fba-b69a-b199c0217bb0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21842024-08-28T23:32:47.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cf074aff-cfe5-4fba-b69a-b199c0217bb0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21852024-08-28T23:32:48.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7b6b4d8-eb5c-429e-9436-e890df225807 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21862024-08-28T23:32:48.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7b6b4d8-eb5c-429e-9436-e890df225807 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21872024-08-28T23:32:48.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c7b6b4d8-eb5c-429e-9436-e890df225807 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21882024-08-28T23:32:49.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7b951410-e189-4bb8-b874-14b98d3e7fb3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21892024-08-28T23:32:49.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7b951410-e189-4bb8-b874-14b98d3e7fb3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21902024-08-28T23:32:49.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7b951410-e189-4bb8-b874-14b98d3e7fb3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21912024-08-28T23:32:50.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f3f49c8e-a0fa-4e4f-9e99-cbd0fe8d8280 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21922024-08-28T23:32:50.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f3f49c8e-a0fa-4e4f-9e99-cbd0fe8d8280 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21932024-08-28T23:32:50.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f3f49c8e-a0fa-4e4f-9e99-cbd0fe8d8280 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21942024-08-28T23:32:51.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcadb93d-cd0a-423d-93ad-899025c57ac9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21952024-08-28T23:32:51.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcadb93d-cd0a-423d-93ad-899025c57ac9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21962024-08-28T23:32:51.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bcadb93d-cd0a-423d-93ad-899025c57ac9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
21972024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
21982024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
21992024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
22002024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
22012024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
22022024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22032024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
22042024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22052024-08-28T23:32:52.089ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
22062024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.86\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
22072024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
22082024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
22092024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
22102024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22112024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22122024-08-28T23:32:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22132024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22142024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
22152024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22162024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22172024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
22182024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
22192024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
22202024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22212024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22222024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22232024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22242024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22252024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22262024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22272024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22282024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
22292024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
22302024-08-28T23:32:52.090ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
22312024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
22322024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22332024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22342024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22352024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
22362024-08-28T23:32:52.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
22372024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22382024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
22392024-08-28T23:32:52.090ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:22:52.090546281 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22402024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
22412024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22422024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22432024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
22442024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22452024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
22462024-08-28T23:32:52.090ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22472024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
22482024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22492024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22502024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
22512024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22522024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
22532024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22542024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
22552024-08-28T23:32:52.090ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22562024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22572024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
22582024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22592024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
22602024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
22612024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22622024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22632024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22642024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
22652024-08-28T23:32:52.090ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22662024-08-28T23:32:52.090ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1320, tv_nsec: 872135788 } })
22672024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22682024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22692024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22702024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22712024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22722024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22732024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22742024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22752024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22762024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22772024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22782024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22792024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22802024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22812024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22822024-08-28T23:32:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22832024-08-28T23:32:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1320, tv_nsec: 873367550 } })
22842024-08-28T23:32:52.092ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22862024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
22872024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.274539ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
22882024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22892024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22902024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912024-08-28T23:32:52.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22922024-08-28T23:32:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.38117ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22932024-08-28T23:32:52.094ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22942024-08-28T23:32:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.558273ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22952024-08-28T23:32:52.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1320, tv_nsec: 875929537 } })
22962024-08-28T23:32:52.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22972024-08-28T23:32:52.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22982024-08-28T23:32:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22992024-08-28T23:32:52.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
23002024-08-28T23:32:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23012024-08-28T23:32:52.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-08-28T23:32:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23032024-08-28T23:32:52.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1320, tv_nsec: 878856910 } })
23042024-08-28T23:32:52.098ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
23052024-08-28T23:32:52.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-08-28T23:32:52.100ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23072024-08-28T23:32:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23082024-08-28T23:32:52.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23092024-08-28T23:32:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23102024-08-28T23:32:52.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23112024-08-28T23:32:52.103ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23122024-08-28T23:32:52.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23132024-08-28T23:32:52.105ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:22:52.090546281 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23142024-08-28T23:32:52.105ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.872991ms iteration = 6 status = {"expiration":"2024-08-28T23:22:52.090546281Z","pruned":[]}
23152024-08-28T23:32:52.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23162024-08-28T23:32:52.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23172024-08-28T23:32:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23182024-08-28T23:32:52.107ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.761436ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
23192024-08-28T23:32:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23202024-08-28T23:32:52.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23212024-08-28T23:32:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23222024-08-28T23:32:52.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23232024-08-28T23:32:52.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23242024-08-28T23:32:52.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23252024-08-28T23:32:52.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23262024-08-28T23:32:52.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23272024-08-28T23:32:52.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282024-08-28T23:32:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23292024-08-28T23:32:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23302024-08-28T23:32:52.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23312024-08-28T23:32:52.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322024-08-28T23:32:52.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23332024-08-28T23:32:52.118ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1320, tv_nsec: 900103617 } })
23342024-08-28T23:32:52.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
23352024-08-28T23:32:52.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23362024-08-28T23:32:52.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23372024-08-28T23:32:52.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23382024-08-28T23:32:52.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23392024-08-28T23:32:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23402024-08-28T23:32:52.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23412024-08-28T23:32:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23422024-08-28T23:32:52.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23432024-08-28T23:32:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23442024-08-28T23:32:52.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23452024-08-28T23:32:52.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23462024-08-28T23:32:52.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23472024-08-28T23:32:52.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23482024-08-28T23:32:52.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23492024-08-28T23:32:52.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23502024-08-28T23:32:52.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-08-28T23:32:52.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522024-08-28T23:32:52.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23532024-08-28T23:32:52.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23542024-08-28T23:32:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23552024-08-28T23:32:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
23562024-08-28T23:32:52.140ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23572024-08-28T23:32:52.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23582024-08-28T23:32:52.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23592024-08-28T23:32:52.144ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
23602024-08-28T23:32:52.144ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23612024-08-28T23:32:52.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23622024-08-28T23:32:52.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23632024-08-28T23:32:52.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23642024-08-28T23:32:52.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652024-08-28T23:32:52.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23662024-08-28T23:32:52.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23672024-08-28T23:32:52.147ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
23682024-08-28T23:32:52.147ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
23692024-08-28T23:32:52.147ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.280444ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
23702024-08-28T23:32:52.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23712024-08-28T23:32:52.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.390035ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
23722024-08-28T23:32:52.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23732024-08-28T23:32:52.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23742024-08-28T23:32:52.149ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23752024-08-28T23:32:52.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23762024-08-28T23:32:52.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23772024-08-28T23:32:52.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23782024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23792024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23802024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23812024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23822024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23832024-08-28T23:32:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23842024-08-28T23:32:52.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.126702ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23852024-08-28T23:32:52.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.172401ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23862024-08-28T23:32:52.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23872024-08-28T23:32:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23882024-08-28T23:32:52.154ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23892024-08-28T23:32:52.154ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23902024-08-28T23:32:52.154ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23912024-08-28T23:32:52.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23922024-08-28T23:32:52.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23932024-08-28T23:32:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23942024-08-28T23:32:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23952024-08-28T23:32:52.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.100566ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
23962024-08-28T23:32:52.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23972024-08-28T23:32:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
23982024-08-28T23:32:52.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23992024-08-28T23:32:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24002024-08-28T23:32:52.170ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24012024-08-28T23:32:52.170ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24022024-08-28T23:32:52.170ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.770274ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24032024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24042024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24052024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24062024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24072024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24082024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24092024-08-28T23:32:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24102024-08-28T23:32:52.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112024-08-28T23:32:52.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-08-28T23:32:52.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24132024-08-28T23:32:52.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24142024-08-28T23:32:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24152024-08-28T23:32:52.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
24162024-08-28T23:32:52.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24172024-08-28T23:32:52.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.782321ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
24182024-08-28T23:32:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24192024-08-28T23:32:52.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24202024-08-28T23:32:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24212024-08-28T23:32:52.178ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24222024-08-28T23:32:52.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24232024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24242024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24252024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
24262024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24272024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24282024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.265911ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
24292024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24302024-08-28T23:32:52.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24312024-08-28T23:32:52.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322024-08-28T23:32:52.185ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
24332024-08-28T23:32:52.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.587734ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24342024-08-28T23:32:52.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24352024-08-28T23:32:52.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24362024-08-28T23:32:52.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24372024-08-28T23:32:52.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24382024-08-28T23:32:52.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24392024-08-28T23:32:52.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402024-08-28T23:32:52.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24412024-08-28T23:32:52.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
24422024-08-28T23:32:52.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24432024-08-28T23:32:52.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
24442024-08-28T23:32:52.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 99.34087ms iteration = 6 status = {"generation":1}
24452024-08-28T23:32:52.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
24462024-08-28T23:32:52.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24472024-08-28T23:32:52.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24482024-08-28T23:32:52.191ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.778934ms iteration = 13 status = {"physical_disks_added":0}
24492024-08-28T23:32:52.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24502024-08-28T23:32:52.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24512024-08-28T23:32:52.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24522024-08-28T23:32:52.193ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.260481ms iteration = 11 status = 0
24532024-08-28T23:32:52.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24542024-08-28T23:32:52.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24552024-08-28T23:32:52.195ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24562024-08-28T23:32:52.195ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.006473ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24572024-08-28T23:32:52.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24582024-08-28T23:32:52.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24592024-08-28T23:32:52.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24602024-08-28T23:32:52.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24612024-08-28T23:32:52.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24622024-08-28T23:32:52.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24632024-08-28T23:32:52.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24642024-08-28T23:32:52.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24652024-08-28T23:32:52.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24662024-08-28T23:32:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24672024-08-28T23:32:52.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24682024-08-28T23:32:52.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24692024-08-28T23:32:52.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24702024-08-28T23:32:52.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24712024-08-28T23:32:52.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24722024-08-28T23:32:52.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24732024-08-28T23:32:52.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24742024-08-28T23:32:52.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24752024-08-28T23:32:52.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24762024-08-28T23:32:52.211ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24772024-08-28T23:32:52.211ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
24782024-08-28T23:32:52.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24792024-08-28T23:32:52.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24802024-08-28T23:32:52.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24812024-08-28T23:32:52.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24822024-08-28T23:32:52.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24832024-08-28T23:32:52.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24842024-08-28T23:32:52.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24852024-08-28T23:32:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24862024-08-28T23:32:52.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24872024-08-28T23:32:52.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24882024-08-28T23:32:52.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24892024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24902024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24912024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
24922024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24932024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
24942024-08-28T23:32:52.219ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 130.003628ms iteration = 6 status = {"generation":2}
24952024-08-28T23:32:52.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24962024-08-28T23:32:52.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24972024-08-28T23:32:52.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24982024-08-28T23:32:52.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24992024-08-28T23:32:52.226ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
25002024-08-28T23:32:52.226ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 136.592609ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25012024-08-28T23:32:52.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25022024-08-28T23:32:52.228ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25032024-08-28T23:32:52.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25042024-08-28T23:32:52.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25052024-08-28T23:32:52.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25062024-08-28T23:32:52.243ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
25072024-08-28T23:32:52.243ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25082024-08-28T23:32:52.243ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f39e4667-15e8-4674-92f9-fc7a35005367", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25092024-08-28T23:32:52.243ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25102024-08-28T23:32:52.243ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25112024-08-28T23:32:52.246ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25122024-08-28T23:32:52.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25132024-08-28T23:32:52.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25142024-08-28T23:32:52.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
25152024-08-28T23:32:52.262ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25162024-08-28T23:32:52.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
25172024-08-28T23:32:52.263ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25182024-08-28T23:32:52.263ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ef071bb1-9253-4100-a490-e914ec6091ef", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25192024-08-28T23:32:52.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25202024-08-28T23:32:52.263ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3cd63c7b-6952-4b37-870e-9b077f1f3f56", "content-length": "26", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25212024-08-28T23:32:52.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25222024-08-28T23:32:52.265ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25232024-08-28T23:32:52.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
25242024-08-28T23:32:52.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25252024-08-28T23:32:52.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25262024-08-28T23:32:52.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25272024-08-28T23:32:52.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25282024-08-28T23:32:52.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25292024-08-28T23:32:52.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25302024-08-28T23:32:52.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25312024-08-28T23:32:52.420ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "735e1c8f-4a06-45d5-ac76-d2d37ac6b2b9", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25322024-08-28T23:32:52.420ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25332024-08-28T23:32:52.422ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1a2739b7-2b38-4f3a-a822-563084f00025", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25342024-08-28T23:32:52.422ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25352024-08-28T23:32:52.423ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25362024-08-28T23:32:52.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.035306ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25372024-08-28T23:32:52.438ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25382024-08-28T23:32:52.442ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25392024-08-28T23:32:52.444ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29581443-31be-452f-b68f-da7c5a9ca629", "content-length": "1", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25402024-08-28T23:32:52.446ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25412024-08-28T23:32:52.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25422024-08-28T23:32:52.476ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 386.802587ms iteration = 11 status = {}
25432024-08-28T23:32:52.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25442024-08-28T23:32:52.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25452024-08-28T23:32:52.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25462024-08-28T23:32:52.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25472024-08-28T23:32:52.505ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 415.384088ms iteration = 11 status = null
25482024-08-28T23:32:52.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25492024-08-28T23:32:52.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25502024-08-28T23:32:52.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25512024-08-28T23:32:52.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25522024-08-28T23:32:52.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25532024-08-28T23:32:52.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25542024-08-28T23:32:52.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-08-28T23:32:52.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25562024-08-28T23:32:52.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25572024-08-28T23:32:52.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25582024-08-28T23:32:52.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25592024-08-28T23:32:52.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25602024-08-28T23:32:52.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25612024-08-28T23:32:52.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25622024-08-28T23:32:52.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25632024-08-28T23:32:52.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25642024-08-28T23:32:52.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25652024-08-28T23:32:52.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25662024-08-28T23:32:52.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25672024-08-28T23:32:52.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25682024-08-28T23:32:52.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25692024-08-28T23:32:52.532ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25702024-08-28T23:32:52.532ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aabde613-44b9-42f5-ac69-5e3ec552ee84", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25712024-08-28T23:32:52.532ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25722024-08-28T23:32:52.533ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7458eafa-8ec0-4029-bc3f-dfc5c3d18c80", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25732024-08-28T23:32:52.534ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25742024-08-28T23:32:52.535ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3f274b78-b1f1-41bb-a953-6485bb13145d", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25752024-08-28T23:32:52.535ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25762024-08-28T23:32:52.537ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25772024-08-28T23:32:52.537ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.288879ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25782024-08-28T23:32:52.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb51971f-2e02-4c53-9b11-198425587813 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
25792024-08-28T23:32:52.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb51971f-2e02-4c53-9b11-198425587813 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
25802024-08-28T23:32:52.577ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97468858-894a-429d-ae39-f03599d37cad", "content-length": "372", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25812024-08-28T23:32:52.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25822024-08-28T23:32:52.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25832024-08-28T23:32:52.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25842024-08-28T23:32:52.583ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "227b0aa6-bd4c-4a08-8acd-8df2e6956015", "content-length": "691", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
25852024-08-28T23:32:52.583ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25862024-08-28T23:32:52.583ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25872024-08-28T23:32:52.583ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25882024-08-28T23:32:52.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb51971f-2e02-4c53-9b11-198425587813 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
25892024-08-28T23:32:52.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25902024-08-28T23:32:52.585ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 495.216462ms iteration = 11 status = {}
25912024-08-28T23:32:52.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25922024-08-28T23:32:52.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25932024-08-28T23:32:52.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25942024-08-28T23:32:52.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25952024-08-28T23:32:52.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25962024-08-28T23:32:52.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972024-08-28T23:32:52.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982024-08-28T23:32:52.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25992024-08-28T23:32:52.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26002024-08-28T23:32:52.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26012024-08-28T23:32:52.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26022024-08-28T23:32:52.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26032024-08-28T23:32:52.591ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
26042024-08-28T23:32:52.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26052024-08-28T23:32:52.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26062024-08-28T23:32:52.593ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26072024-08-28T23:32:52.593ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e42a9c3-1c01-47ca-bea8-191fda24e552", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26082024-08-28T23:32:52.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26092024-08-28T23:32:52.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26102024-08-28T23:32:52.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26112024-08-28T23:32:52.595ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 504.876958ms iteration = 11 status = {}
26122024-08-28T23:32:52.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26132024-08-28T23:32:52.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26142024-08-28T23:32:52.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26152024-08-28T23:32:52.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26162024-08-28T23:32:52.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26172024-08-28T23:32:52.600ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26182024-08-28T23:32:52.600ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9149c12-aaaa-4c5c-8515-c8e032a6cfd3", "content-length": "121", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26192024-08-28T23:32:52.600ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
26202024-08-28T23:32:52.600ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
26212024-08-28T23:32:52.601ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26222024-08-28T23:32:52.601ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26232024-08-28T23:32:52.601ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
26242024-08-28T23:32:52.601ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
26252024-08-28T23:32:52.601ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
26262024-08-28T23:32:52.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26272024-08-28T23:32:52.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26282024-08-28T23:32:52.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26292024-08-28T23:32:52.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26302024-08-28T23:32:52.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26312024-08-28T23:32:52.603ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26322024-08-28T23:32:52.603ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cef25203-4b8f-4c01-b0dd-818bc1009ca5", "content-length": "2", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26332024-08-28T23:32:52.603ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26342024-08-28T23:32:52.603ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a4b24ddc-4ce8-4161-ae6b-b8ed7fb86c4d", "content-length": "52", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26352024-08-28T23:32:52.603ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
26362024-08-28T23:32:52.603ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26372024-08-28T23:32:52.607ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 87407a27-caf9-43a9-896c-044998795dfd, kind: Service { id: 424187fd-4660-4136-ae99-d26e8a3dc7ec }, name: Name("nexus-424187fd-4660-4136-ae99-d26e8a3dc7ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dd871de-3b89-498c-b830-f0f53b4d3cba, kind: Service { id: 3993a6cd-8824-4157-87d4-d2c9ab21ecd8 }, name: Name("nexus-3993a6cd-8824-4157-87d4-d2c9ab21ecd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce39ba4c-cf75-4d6e-9871-be0b9fc100b0, kind: Service { id: 6ebaa7a9-ad76-4825-99aa-37707c0fe64c }, name: Name("nexus-6ebaa7a9-ad76-4825-99aa-37707c0fe64c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 73a98c7d-ca24-4f69-ab94-10bde4e2aeef, kind: Service { id: bf9867b8-4340-4b2d-8034-f00632878d92 }, name: Name("external-dns-bf9867b8-4340-4b2d-8034-f00632878d92"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e495b301-b017-4ec2-89e5-06c21a09e079, kind: Service { id: 219f2a7b-fe2d-4299-b4e9-e2bd11379c00 }, name: Name("external-dns-219f2a7b-fe2d-4299-b4e9-e2bd11379c00"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
26382024-08-28T23:32:52.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26392024-08-28T23:32:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26402024-08-28T23:32:52.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26412024-08-28T23:32:52.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
26422024-08-28T23:32:52.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26432024-08-28T23:32:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26442024-08-28T23:32:52.611ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26452024-08-28T23:32:52.612ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 73a98c7d-ca24-4f69-ab94-10bde4e2aeef, kind: Service { id: bf9867b8-4340-4b2d-8034-f00632878d92 }, name: Name("external-dns-bf9867b8-4340-4b2d-8034-f00632878d92"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e495b301-b017-4ec2-89e5-06c21a09e079, kind: Service { id: 219f2a7b-fe2d-4299-b4e9-e2bd11379c00 }, name: Name("external-dns-219f2a7b-fe2d-4299-b4e9-e2bd11379c00"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 11])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 87407a27-caf9-43a9-896c-044998795dfd, kind: Service { id: 424187fd-4660-4136-ae99-d26e8a3dc7ec }, name: Name("nexus-424187fd-4660-4136-ae99-d26e8a3dc7ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dd871de-3b89-498c-b830-f0f53b4d3cba, kind: Service { id: 3993a6cd-8824-4157-87d4-d2c9ab21ecd8 }, name: Name("nexus-3993a6cd-8824-4157-87d4-d2c9ab21ecd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce39ba4c-cf75-4d6e-9871-be0b9fc100b0, kind: Service { id: 6ebaa7a9-ad76-4825-99aa-37707c0fe64c }, name: Name("nexus-6ebaa7a9-ad76-4825-99aa-37707c0fe64c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26462024-08-28T23:32:52.612ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26472024-08-28T23:32:52.671ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, time_created: 2024-08-28T23:27:51.784401Z, time_modified: 2024-08-28T23:27:51.784401Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
26482024-08-28T23:32:52.671ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
26492024-08-28T23:32:52.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26502024-08-28T23:32:52.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26512024-08-28T23:32:52.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26522024-08-28T23:32:52.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26532024-08-28T23:32:52.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26542024-08-28T23:32:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
26552024-08-28T23:32:52.700ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4a71ea24-0a90-44f9-aa2d-f5d62b6ee7ae", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26562024-08-28T23:32:52.700ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
26572024-08-28T23:32:52.700ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26582024-08-28T23:32:52.701ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c704fa59-137c-43ab-b048-1336682b2624", "content-length": "667", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26592024-08-28T23:32:52.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26602024-08-28T23:32:52.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26612024-08-28T23:32:52.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26622024-08-28T23:32:52.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26632024-08-28T23:32:52.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26642024-08-28T23:32:52.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26652024-08-28T23:32:52.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26662024-08-28T23:32:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26672024-08-28T23:32:52.712ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26682024-08-28T23:32:52.713ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a4283ae2-9456-4c54-b4e0-b1bc02412ac0", "date": "Wed, 28 Aug 2024 23:32:52 GMT"} })
26692024-08-28T23:32:52.714ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
26702024-08-28T23:32:52.714ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 623.958388ms
26712024-08-28T23:32:52.714ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 623.969068ms iteration = 2 status = {}
26722024-08-28T23:32:52.718ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.877879ms iteration = 11 status = {}
26732024-08-28T23:32:52.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 427 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = a099764d-6e04-4ca5-9734-f7d8ec39aebd response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
26742024-08-28T23:32:53.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c95faf87-89fa-44f8-97b7-29c03e4a46a4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26752024-08-28T23:32:53.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c95faf87-89fa-44f8-97b7-29c03e4a46a4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26762024-08-28T23:32:53.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c95faf87-89fa-44f8-97b7-29c03e4a46a4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26772024-08-28T23:32:54.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 350963fc-88a3-4d61-b953-ce6764023e5c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26782024-08-28T23:32:54.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 350963fc-88a3-4d61-b953-ce6764023e5c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26792024-08-28T23:32:54.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 350963fc-88a3-4d61-b953-ce6764023e5c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26802024-08-28T23:32:55.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 35d697de-96cf-422b-ae44-af71b0dd6762 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26812024-08-28T23:32:55.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 35d697de-96cf-422b-ae44-af71b0dd6762 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26822024-08-28T23:32:55.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 35d697de-96cf-422b-ae44-af71b0dd6762 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26832024-08-28T23:32:56.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4d622876-9696-470f-a08a-f51e9c1b5bf4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26842024-08-28T23:32:56.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4d622876-9696-470f-a08a-f51e9c1b5bf4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26852024-08-28T23:32:56.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4d622876-9696-470f-a08a-f51e9c1b5bf4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26862024-08-28T23:32:57.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = faf61d4b-589c-497c-b82a-7b901547d643 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26872024-08-28T23:32:57.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = faf61d4b-589c-497c-b82a-7b901547d643 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26882024-08-28T23:32:57.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = faf61d4b-589c-497c-b82a-7b901547d643 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26892024-08-28T23:32:58.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cd2a7ed-e110-4662-b2d1-7d6eaf859959 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26902024-08-28T23:32:58.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cd2a7ed-e110-4662-b2d1-7d6eaf859959 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26912024-08-28T23:32:58.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2cd2a7ed-e110-4662-b2d1-7d6eaf859959 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26922024-08-28T23:32:59.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f455a8c9-cab0-44d4-acf2-5f64c8218c9b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26932024-08-28T23:32:59.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f455a8c9-cab0-44d4-acf2-5f64c8218c9b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26942024-08-28T23:32:59.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f455a8c9-cab0-44d4-acf2-5f64c8218c9b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26952024-08-28T23:33:00.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 717466d2-0009-46dd-89a4-b088ece8ca96 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26962024-08-28T23:33:00.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 717466d2-0009-46dd-89a4-b088ece8ca96 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26972024-08-28T23:33:00.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 717466d2-0009-46dd-89a4-b088ece8ca96 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26982024-08-28T23:33:01.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b80d2fa1-962a-4257-9716-fbaa0e64e20a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
26992024-08-28T23:33:01.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b80d2fa1-962a-4257-9716-fbaa0e64e20a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27002024-08-28T23:33:01.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b80d2fa1-962a-4257-9716-fbaa0e64e20a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27012024-08-28T23:33:02.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
27022024-08-28T23:33:02.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27032024-08-28T23:33:02.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27042024-08-28T23:33:02.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
27052024-08-28T23:33:02.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27062024-08-28T23:33:02.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072024-08-28T23:33:02.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27082024-08-28T23:33:02.093ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27092024-08-28T23:33:02.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27102024-08-28T23:33:02.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27112024-08-28T23:33:02.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27122024-08-28T23:33:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27132024-08-28T23:33:02.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27142024-08-28T23:33:02.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27152024-08-28T23:33:02.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162024-08-28T23:33:02.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
27172024-08-28T23:33:02.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27182024-08-28T23:33:02.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27192024-08-28T23:33:02.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
27202024-08-28T23:33:02.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.613929ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
27212024-08-28T23:33:02.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.465298ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27222024-08-28T23:33:02.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 409 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = f7b25231-9805-4942-ae1e-4168af141047 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
27232024-08-28T23:33:02.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e143b443-27d6-4156-a2f7-d236060017bc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27242024-08-28T23:33:02.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e143b443-27d6-4156-a2f7-d236060017bc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27252024-08-28T23:33:02.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e143b443-27d6-4156-a2f7-d236060017bc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27262024-08-28T23:33:03.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4064e91d-00d5-45fa-8585-486b1b050641 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27272024-08-28T23:33:03.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4064e91d-00d5-45fa-8585-486b1b050641 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27282024-08-28T23:33:03.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4064e91d-00d5-45fa-8585-486b1b050641 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27292024-08-28T23:33:04.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = db21ac35-031a-4699-ae15-94eac9e3edb9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27302024-08-28T23:33:04.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = db21ac35-031a-4699-ae15-94eac9e3edb9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27312024-08-28T23:33:04.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = db21ac35-031a-4699-ae15-94eac9e3edb9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27322024-08-28T23:33:05.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f393b4d8-2974-4bc1-b5bb-d777d4ec5b2f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27332024-08-28T23:33:05.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f393b4d8-2974-4bc1-b5bb-d777d4ec5b2f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27342024-08-28T23:33:05.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f393b4d8-2974-4bc1-b5bb-d777d4ec5b2f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27352024-08-28T23:33:06.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c8050c3a-2a29-4696-9f5a-fb12b7559529 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27362024-08-28T23:33:06.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c8050c3a-2a29-4696-9f5a-fb12b7559529 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27372024-08-28T23:33:06.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c8050c3a-2a29-4696-9f5a-fb12b7559529 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27382024-08-28T23:33:08.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce9834ca-0125-4108-94c2-467344964a82 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27392024-08-28T23:33:08.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce9834ca-0125-4108-94c2-467344964a82 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27402024-08-28T23:33:08.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce9834ca-0125-4108-94c2-467344964a82 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27412024-08-28T23:33:09.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8d4f4def-b749-455a-8d6a-b42d800aa6a6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27422024-08-28T23:33:09.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8d4f4def-b749-455a-8d6a-b42d800aa6a6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27432024-08-28T23:33:09.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8d4f4def-b749-455a-8d6a-b42d800aa6a6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27442024-08-28T23:33:10.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65095cd5-b988-4016-b789-fdc94ef7d3ae roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27452024-08-28T23:33:10.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65095cd5-b988-4016-b789-fdc94ef7d3ae resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27462024-08-28T23:33:10.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 65095cd5-b988-4016-b789-fdc94ef7d3ae response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27472024-08-28T23:33:11.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e41808e4-b12d-4cb3-aea9-89267725fa10 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27482024-08-28T23:33:11.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e41808e4-b12d-4cb3-aea9-89267725fa10 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27492024-08-28T23:33:11.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e41808e4-b12d-4cb3-aea9-89267725fa10 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27502024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
27512024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27522024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27532024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
27542024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27552024-08-28T23:33:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27562024-08-28T23:33:12.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-08-28T23:33:12.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27582024-08-28T23:33:12.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27592024-08-28T23:33:12.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.476344ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27602024-08-28T23:33:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27612024-08-28T23:33:12.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27622024-08-28T23:33:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27632024-08-28T23:33:12.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27642024-08-28T23:33:12.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27652024-08-28T23:33:12.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27662024-08-28T23:33:12.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
27672024-08-28T23:33:12.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27682024-08-28T23:33:12.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27692024-08-28T23:33:12.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4d7e28f-1518-4375-8216-f91f4d740fe6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27702024-08-28T23:33:12.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4d7e28f-1518-4375-8216-f91f4d740fe6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27712024-08-28T23:33:12.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4d7e28f-1518-4375-8216-f91f4d740fe6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27722024-08-28T23:33:12.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
27732024-08-28T23:33:12.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.599551ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
27742024-08-28T23:33:12.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = d02e1389-3ac2-4a64-9e2d-7f7643de9b06 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
27752024-08-28T23:33:13.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7a19994b-c8d7-4748-a6d3-cd75f2284c1f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27762024-08-28T23:33:13.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7a19994b-c8d7-4748-a6d3-cd75f2284c1f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27772024-08-28T23:33:13.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7a19994b-c8d7-4748-a6d3-cd75f2284c1f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27782024-08-28T23:33:14.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3de9f64b-86d5-46a0-869d-40875f1ea7b4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27792024-08-28T23:33:14.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3de9f64b-86d5-46a0-869d-40875f1ea7b4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27802024-08-28T23:33:14.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3de9f64b-86d5-46a0-869d-40875f1ea7b4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27812024-08-28T23:33:15.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 728fc020-7087-4799-9771-6459035f9b6f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27822024-08-28T23:33:15.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 728fc020-7087-4799-9771-6459035f9b6f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27832024-08-28T23:33:15.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 728fc020-7087-4799-9771-6459035f9b6f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27842024-08-28T23:33:16.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 80bdeb29-879e-45a9-998e-3bf296f49edd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27852024-08-28T23:33:16.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 80bdeb29-879e-45a9-998e-3bf296f49edd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27862024-08-28T23:33:16.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 80bdeb29-879e-45a9-998e-3bf296f49edd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27872024-08-28T23:33:17.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e983d378-9cba-4784-a14a-05b996a823a0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27882024-08-28T23:33:17.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e983d378-9cba-4784-a14a-05b996a823a0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27892024-08-28T23:33:17.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e983d378-9cba-4784-a14a-05b996a823a0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27902024-08-28T23:33:18.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 127169d1-7203-40fb-9163-edff94863efd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27912024-08-28T23:33:18.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 127169d1-7203-40fb-9163-edff94863efd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27922024-08-28T23:33:18.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 127169d1-7203-40fb-9163-edff94863efd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27932024-08-28T23:33:19.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5c4ff66-4d3e-4a8d-b3da-80b0b3ba0e08 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27942024-08-28T23:33:19.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5c4ff66-4d3e-4a8d-b3da-80b0b3ba0e08 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27952024-08-28T23:33:19.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5c4ff66-4d3e-4a8d-b3da-80b0b3ba0e08 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27962024-08-28T23:33:20.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dc51191f-3e6e-4191-a6ac-9047d4f6357e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27972024-08-28T23:33:20.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dc51191f-3e6e-4191-a6ac-9047d4f6357e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27982024-08-28T23:33:20.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dc51191f-3e6e-4191-a6ac-9047d4f6357e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
27992024-08-28T23:33:21.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55da5bec-8ade-454e-84de-e1c866c32ede roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
28002024-08-28T23:33:21.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55da5bec-8ade-454e-84de-e1c866c32ede resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
28012024-08-28T23:33:21.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55da5bec-8ade-454e-84de-e1c866c32ede response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
28022024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
28032024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
28042024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28052024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
28062024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
28072024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
28082024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28092024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28102024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28112024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28122024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28132024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28142024-08-28T23:33:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28152024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
28162024-08-28T23:33:22.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
28172024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
28182024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28192024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
28202024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28212024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28222024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
28232024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28242024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
28252024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28262024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
28272024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28282024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
28292024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28302024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
28312024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28322024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28332024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
28342024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
28352024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28362024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28372024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
28382024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28392024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28402024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28412024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28422024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28432024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28442024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28452024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28462024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28472024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28482024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28492024-08-28T23:33:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28502024-08-28T23:33:22.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28512024-08-28T23:33:22.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 875462749 } })
28522024-08-28T23:33:22.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.507962ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28532024-08-28T23:33:22.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-08-28T23:33:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
28552024-08-28T23:33:22.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562024-08-28T23:33:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 876598169 } })
28572024-08-28T23:33:22.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
28582024-08-28T23:33:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28592024-08-28T23:33:22.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28602024-08-28T23:33:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28612024-08-28T23:33:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28622024-08-28T23:33:22.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28632024-08-28T23:33:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28642024-08-28T23:33:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28652024-08-28T23:33:22.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28662024-08-28T23:33:22.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28672024-08-28T23:33:22.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28682024-08-28T23:33:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28692024-08-28T23:33:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28702024-08-28T23:33:22.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28712024-08-28T23:33:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28722024-08-28T23:33:22.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28732024-08-28T23:33:22.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28742024-08-28T23:33:22.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.649332ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
28752024-08-28T23:33:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28762024-08-28T23:33:22.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28772024-08-28T23:33:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28782024-08-28T23:33:22.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28792024-08-28T23:33:22.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28802024-08-28T23:33:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28812024-08-28T23:33:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28822024-08-28T23:33:22.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28832024-08-28T23:33:22.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 888786482 } })
28842024-08-28T23:33:22.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
28852024-08-28T23:33:22.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28862024-08-28T23:33:22.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28872024-08-28T23:33:22.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28882024-08-28T23:33:22.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28892024-08-28T23:33:22.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28902024-08-28T23:33:22.128ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
28912024-08-28T23:33:22.128ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28922024-08-28T23:33:22.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28932024-08-28T23:33:22.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28942024-08-28T23:33:22.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28952024-08-28T23:33:22.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28962024-08-28T23:33:22.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28972024-08-28T23:33:22.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28982024-08-28T23:33:22.130ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28992024-08-28T23:33:22.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29002024-08-28T23:33:22.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29012024-08-28T23:33:22.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29022024-08-28T23:33:22.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29032024-08-28T23:33:22.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29042024-08-28T23:33:22.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052024-08-28T23:33:22.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.863674ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
29072024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
29082024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29092024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29102024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
29112024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29122024-08-28T23:33:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29132024-08-28T23:33:22.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.120962ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29142024-08-28T23:33:22.144ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.817443ms iteration = 12 status = 0
29152024-08-28T23:33:22.145ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162024-08-28T23:33:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29172024-08-28T23:33:22.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29182024-08-28T23:33:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29192024-08-28T23:33:22.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29202024-08-28T23:33:22.151ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
29212024-08-28T23:33:22.151ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.93699ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
29222024-08-28T23:33:22.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29232024-08-28T23:33:22.151ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29242024-08-28T23:33:22.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29252024-08-28T23:33:22.157ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.089432ms iteration = 14 status = {"physical_disks_added":0}
29262024-08-28T23:33:22.159ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29272024-08-28T23:33:22.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.597162ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29282024-08-28T23:33:22.168ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
29292024-08-28T23:33:22.168ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29302024-08-28T23:33:22.168ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.448631ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
29312024-08-28T23:33:22.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29322024-08-28T23:33:22.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.57125ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29332024-08-28T23:33:22.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29342024-08-28T23:33:22.172ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
29352024-08-28T23:33:22.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.25192ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29362024-08-28T23:33:22.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
29372024-08-28T23:33:22.176ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29382024-08-28T23:33:22.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c32e6536-a971-482a-aaf3-abeb307e4f37", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
29392024-08-28T23:33:22.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29402024-08-28T23:33:22.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29412024-08-28T23:33:22.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
29422024-08-28T23:33:22.186ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29432024-08-28T23:33:22.186ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c88dbdae-95b5-4115-a54a-ca7d261abde7", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
29442024-08-28T23:33:22.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29452024-08-28T23:33:22.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29462024-08-28T23:33:22.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
29472024-08-28T23:33:22.193ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29482024-08-28T23:33:22.193ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb2f205-774e-4a5e-b22d-60ed051a042c", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
29492024-08-28T23:33:22.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29502024-08-28T23:33:22.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
29512024-08-28T23:33:22.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29522024-08-28T23:33:22.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29532024-08-28T23:33:22.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29542024-08-28T23:33:22.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29552024-08-28T23:33:22.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-08-28T23:33:22.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29572024-08-28T23:33:22.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29582024-08-28T23:33:22.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29592024-08-28T23:33:22.324ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 234.268839ms iteration = 12 status = {}
29602024-08-28T23:33:22.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 27114326-5e58-4b74-98a7-6a27029330ac roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
29612024-08-28T23:33:22.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 27114326-5e58-4b74-98a7-6a27029330ac resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
29622024-08-28T23:33:22.400ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29632024-08-28T23:33:22.401ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5784ef72-8b51-4092-8a19-3034135ce481", "content-length": "1", "date": "Wed, 28 Aug 2024 23:33:21 GMT"} })
29642024-08-28T23:33:22.402ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29652024-08-28T23:33:22.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29662024-08-28T23:33:22.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29672024-08-28T23:33:22.404ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ab0abb3-08ba-42eb-a771-1442393121a8", "content-length": "372", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
29682024-08-28T23:33:22.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29692024-08-28T23:33:22.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29702024-08-28T23:33:22.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712024-08-28T23:33:22.406ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.345213ms iteration = 12 status = null
29722024-08-28T23:33:22.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29732024-08-28T23:33:22.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29742024-08-28T23:33:22.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29752024-08-28T23:33:22.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 27114326-5e58-4b74-98a7-6a27029330ac response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
29762024-08-28T23:33:22.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29772024-08-28T23:33:22.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29782024-08-28T23:33:22.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29792024-08-28T23:33:22.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29802024-08-28T23:33:22.418ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29812024-08-28T23:33:22.419ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8c84d7c4-a13a-4d70-9e7e-8f573c797141", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
29822024-08-28T23:33:22.421ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 330.118824ms iteration = 12 status = {}
29832024-08-28T23:33:22.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29842024-08-28T23:33:22.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29852024-08-28T23:33:22.450ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
29862024-08-28T23:33:22.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29872024-08-28T23:33:22.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29882024-08-28T23:33:22.460ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29892024-08-28T23:33:22.460ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8406a6d7-5361-4459-a16e-749b1351e496", "content-length": "121", "date": "Wed, 28 Aug 2024 23:33:21 GMT"} })
29902024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
29912024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
29922024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29932024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29942024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
29952024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
29962024-08-28T23:33:22.460ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
29972024-08-28T23:33:22.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29982024-08-28T23:33:22.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29992024-08-28T23:33:22.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30002024-08-28T23:33:22.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c8b03f0-4e64-473c-8b0b-f7b4dadd1104", "content-length": "2", "date": "Wed, 28 Aug 2024 23:33:21 GMT"} })
30012024-08-28T23:33:22.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30022024-08-28T23:33:22.463ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d980952c-59fd-4524-9830-a63c48833a64", "content-length": "52", "date": "Wed, 28 Aug 2024 23:33:21 GMT"} })
30032024-08-28T23:33:22.463ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
30042024-08-28T23:33:22.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30052024-08-28T23:33:22.493ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30062024-08-28T23:33:22.549ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "335208eb-5fdb-4f2b-8192-a3c4f34d0d0d", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
30072024-08-28T23:33:22.549ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
30082024-08-28T23:33:22.549ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30092024-08-28T23:33:22.550ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63e860c5-97d5-445c-aef9-bce8bf660184", "content-length": "691", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
30102024-08-28T23:33:22.550ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30112024-08-28T23:33:22.550ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30122024-08-28T23:33:22.550ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30132024-08-28T23:33:22.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "702bccf6-b206-4a82-a469-0e6ca9504f35", "content-length": "667", "date": "Wed, 28 Aug 2024 23:33:22 GMT"} })
30142024-08-28T23:33:22.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30152024-08-28T23:33:22.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30162024-08-28T23:33:22.551ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.456889ms iteration = 12 status = {}
30172024-08-28T23:33:22.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30182024-08-28T23:33:22.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30192024-08-28T23:33:22.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30202024-08-28T23:33:22.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30212024-08-28T23:33:22.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30222024-08-28T23:33:22.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30232024-08-28T23:33:22.567ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 475.958621ms iteration = 12 status = {}
30242024-08-28T23:33:22.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 437 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 50ff81e4-407e-4690-b93b-6ef545d041a7 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
30252024-08-28T23:33:23.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ceca8d48-1a8b-4d93-9009-5be9c0d589ea roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30262024-08-28T23:33:23.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ceca8d48-1a8b-4d93-9009-5be9c0d589ea resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30272024-08-28T23:33:23.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ceca8d48-1a8b-4d93-9009-5be9c0d589ea response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30282024-08-28T23:33:24.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bce50991-8bc6-41bf-8ec9-2fdbfedbea6b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30292024-08-28T23:33:24.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bce50991-8bc6-41bf-8ec9-2fdbfedbea6b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30302024-08-28T23:33:24.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bce50991-8bc6-41bf-8ec9-2fdbfedbea6b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30312024-08-28T23:33:25.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b8933e5-f248-4153-b6a3-85150143aca4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30322024-08-28T23:33:25.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b8933e5-f248-4153-b6a3-85150143aca4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30332024-08-28T23:33:25.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8b8933e5-f248-4153-b6a3-85150143aca4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30342024-08-28T23:33:26.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c67785-96d2-49a9-a998-95bbcb71c0ad roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30352024-08-28T23:33:26.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c67785-96d2-49a9-a998-95bbcb71c0ad resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30362024-08-28T23:33:26.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c67785-96d2-49a9-a998-95bbcb71c0ad response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30372024-08-28T23:33:27.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bb1df21-5300-4d29-a44b-a807c3d5b6ca roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30382024-08-28T23:33:27.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bb1df21-5300-4d29-a44b-a807c3d5b6ca resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30392024-08-28T23:33:27.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bb1df21-5300-4d29-a44b-a807c3d5b6ca response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30402024-08-28T23:33:28.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dfb6bf12-9d0c-4e6d-ba83-8bd53135e959 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30412024-08-28T23:33:28.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dfb6bf12-9d0c-4e6d-ba83-8bd53135e959 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30422024-08-28T23:33:28.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dfb6bf12-9d0c-4e6d-ba83-8bd53135e959 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30432024-08-28T23:33:29.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78d3a488-b7a1-47be-99ea-47a38b0f0800 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30442024-08-28T23:33:29.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78d3a488-b7a1-47be-99ea-47a38b0f0800 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30452024-08-28T23:33:29.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78d3a488-b7a1-47be-99ea-47a38b0f0800 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30462024-08-28T23:33:30.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0380bc92-5407-41d7-9b96-a3747ff00b47 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30472024-08-28T23:33:30.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0380bc92-5407-41d7-9b96-a3747ff00b47 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30482024-08-28T23:33:30.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0380bc92-5407-41d7-9b96-a3747ff00b47 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30492024-08-28T23:33:31.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 466d4dc2-3843-45cd-8d01-dbf0803b5d8f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30502024-08-28T23:33:31.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 466d4dc2-3843-45cd-8d01-dbf0803b5d8f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30512024-08-28T23:33:31.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 466d4dc2-3843-45cd-8d01-dbf0803b5d8f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30522024-08-28T23:33:32.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
30532024-08-28T23:33:32.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30542024-08-28T23:33:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30552024-08-28T23:33:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
30562024-08-28T23:33:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30572024-08-28T23:33:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30582024-08-28T23:33:32.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592024-08-28T23:33:32.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30602024-08-28T23:33:32.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30612024-08-28T23:33:32.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.338561ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30622024-08-28T23:33:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30632024-08-28T23:33:32.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30642024-08-28T23:33:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30652024-08-28T23:33:32.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30662024-08-28T23:33:32.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30672024-08-28T23:33:32.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30682024-08-28T23:33:32.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
30692024-08-28T23:33:32.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30702024-08-28T23:33:32.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30712024-08-28T23:33:32.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
30722024-08-28T23:33:32.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.978739ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
30732024-08-28T23:33:32.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d53181-0cd9-4e36-8733-ce14f37326aa roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30742024-08-28T23:33:32.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d53181-0cd9-4e36-8733-ce14f37326aa resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30752024-08-28T23:33:32.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67d53181-0cd9-4e36-8733-ce14f37326aa response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30762024-08-28T23:33:32.817ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 800 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 07f53953-7d7a-4c8e-afd5-7b28730ae05c response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
30772024-08-28T23:33:33.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4601e57-7832-49ba-bb4d-74fe6366057c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30782024-08-28T23:33:33.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4601e57-7832-49ba-bb4d-74fe6366057c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30792024-08-28T23:33:33.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b4601e57-7832-49ba-bb4d-74fe6366057c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30802024-08-28T23:33:34.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 187980b2-8092-4d7f-be10-5e556f9a5517 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30812024-08-28T23:33:34.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 187980b2-8092-4d7f-be10-5e556f9a5517 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30822024-08-28T23:33:34.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 187980b2-8092-4d7f-be10-5e556f9a5517 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30832024-08-28T23:33:35.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 76c5bd70-bbf0-409d-9db8-6cb8fe9d5731 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30842024-08-28T23:33:35.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 76c5bd70-bbf0-409d-9db8-6cb8fe9d5731 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30852024-08-28T23:33:35.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 76c5bd70-bbf0-409d-9db8-6cb8fe9d5731 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30862024-08-28T23:33:36.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 89eefd4b-c229-42d5-be8d-2e09418ebb3f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30872024-08-28T23:33:36.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 89eefd4b-c229-42d5-be8d-2e09418ebb3f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30882024-08-28T23:33:36.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 89eefd4b-c229-42d5-be8d-2e09418ebb3f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30892024-08-28T23:33:37.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97dfc575-aa21-4f98-a805-3a128726b9ee roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30902024-08-28T23:33:37.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97dfc575-aa21-4f98-a805-3a128726b9ee resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30912024-08-28T23:33:37.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97dfc575-aa21-4f98-a805-3a128726b9ee response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30922024-08-28T23:33:38.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f07b469e-ed0f-4296-9bf0-f1d63d9c3cd1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30932024-08-28T23:33:38.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f07b469e-ed0f-4296-9bf0-f1d63d9c3cd1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30942024-08-28T23:33:38.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f07b469e-ed0f-4296-9bf0-f1d63d9c3cd1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30952024-08-28T23:33:39.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0bc110eb-4f9e-400b-b611-e342ad877cd3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30962024-08-28T23:33:39.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0bc110eb-4f9e-400b-b611-e342ad877cd3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30972024-08-28T23:33:39.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0bc110eb-4f9e-400b-b611-e342ad877cd3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30982024-08-28T23:33:40.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74578340-d6fd-4010-8f7e-b74cc4268e4d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
30992024-08-28T23:33:40.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74578340-d6fd-4010-8f7e-b74cc4268e4d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31002024-08-28T23:33:40.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74578340-d6fd-4010-8f7e-b74cc4268e4d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31012024-08-28T23:33:41.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25428ee8-45bc-4e38-89a5-10d441574df3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31022024-08-28T23:33:41.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25428ee8-45bc-4e38-89a5-10d441574df3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31032024-08-28T23:33:41.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25428ee8-45bc-4e38-89a5-10d441574df3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31042024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
31052024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31062024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31072024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
31082024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31092024-08-28T23:33:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31102024-08-28T23:33:42.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-08-28T23:33:42.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31122024-08-28T23:33:42.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31132024-08-28T23:33:42.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.383902ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31142024-08-28T23:33:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31152024-08-28T23:33:42.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31162024-08-28T23:33:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31172024-08-28T23:33:42.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31182024-08-28T23:33:42.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31192024-08-28T23:33:42.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202024-08-28T23:33:42.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
31212024-08-28T23:33:42.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31222024-08-28T23:33:42.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31232024-08-28T23:33:42.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
31242024-08-28T23:33:42.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.986241ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
31252024-08-28T23:33:42.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 712 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 07bb876c-4a90-47fd-ad4c-d26794f672f3 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
31262024-08-28T23:33:42.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5e055ccc-45c5-4d98-9ed8-3c0f061b4d71 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31272024-08-28T23:33:42.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5e055ccc-45c5-4d98-9ed8-3c0f061b4d71 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31282024-08-28T23:33:42.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5e055ccc-45c5-4d98-9ed8-3c0f061b4d71 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31292024-08-28T23:33:43.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d42b6618-40e2-40e9-a277-c48d627f2c42 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31302024-08-28T23:33:43.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d42b6618-40e2-40e9-a277-c48d627f2c42 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31312024-08-28T23:33:43.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d42b6618-40e2-40e9-a277-c48d627f2c42 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31322024-08-28T23:33:44.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f680f20-bfda-43b2-9d03-79ba7f9dc8ed roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31332024-08-28T23:33:44.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f680f20-bfda-43b2-9d03-79ba7f9dc8ed resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31342024-08-28T23:33:44.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f680f20-bfda-43b2-9d03-79ba7f9dc8ed response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31352024-08-28T23:33:45.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc192df1-1e2c-46d3-a60f-7f1aca7ac5a5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31362024-08-28T23:33:45.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc192df1-1e2c-46d3-a60f-7f1aca7ac5a5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31372024-08-28T23:33:45.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc192df1-1e2c-46d3-a60f-7f1aca7ac5a5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31382024-08-28T23:33:46.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = accd367e-88be-47f1-a4bb-1fa025a6db51 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31392024-08-28T23:33:46.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = accd367e-88be-47f1-a4bb-1fa025a6db51 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31402024-08-28T23:33:46.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = accd367e-88be-47f1-a4bb-1fa025a6db51 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31412024-08-28T23:33:47.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7e4d5bf6-7b20-4de9-aedb-ab445e299067 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31422024-08-28T23:33:47.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7e4d5bf6-7b20-4de9-aedb-ab445e299067 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31432024-08-28T23:33:47.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7e4d5bf6-7b20-4de9-aedb-ab445e299067 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31442024-08-28T23:33:48.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18ae3669-b4ab-404d-8b2e-0f3b1929332a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31452024-08-28T23:33:48.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18ae3669-b4ab-404d-8b2e-0f3b1929332a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31462024-08-28T23:33:48.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 18ae3669-b4ab-404d-8b2e-0f3b1929332a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31472024-08-28T23:33:49.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae55e274-46d8-427a-9c5b-811a7bf7327f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31482024-08-28T23:33:49.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae55e274-46d8-427a-9c5b-811a7bf7327f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31492024-08-28T23:33:50.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae55e274-46d8-427a-9c5b-811a7bf7327f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31502024-08-28T23:33:51.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63788730-d389-4637-967d-9d58b2230f30 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31512024-08-28T23:33:51.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63788730-d389-4637-967d-9d58b2230f30 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31522024-08-28T23:33:51.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 63788730-d389-4637-967d-9d58b2230f30 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31532024-08-28T23:33:52.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b64b70d3-a4df-46b7-8bef-64b7ad77bf94 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31542024-08-28T23:33:52.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b64b70d3-a4df-46b7-8bef-64b7ad77bf94 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31552024-08-28T23:33:52.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b64b70d3-a4df-46b7-8bef-64b7ad77bf94 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
31562024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
31572024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
31582024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
31592024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
31602024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
31612024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31622024-08-28T23:33:52.090ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
31632024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31642024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31652024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.91\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
31662024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
31672024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
31682024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31692024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
31702024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
31712024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31722024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31732024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
31742024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
31752024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
31762024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
31772024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31782024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31792024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
31802024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31812024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31822024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
31832024-08-28T23:33:52.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
31842024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31852024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
31862024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31872024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
31882024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
31892024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31902024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31912024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31922024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
31932024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31942024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
31952024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
31962024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31972024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31982024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
31992024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32002024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
32012024-08-28T23:33:52.090ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32022024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
32032024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32042024-08-28T23:33:52.090ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:23:52.090456311 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32052024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32062024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
32072024-08-28T23:33:52.090ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
32082024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32092024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
32102024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32112024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
32122024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32132024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
32142024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32152024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
32162024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32172024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32182024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32192024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32202024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32212024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32222024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32232024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32242024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32252024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32262024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32272024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32282024-08-28T23:33:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32292024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32302024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32312024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32322024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32332024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32342024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32352024-08-28T23:33:52.091ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 872461344 } })
32362024-08-28T23:33:52.091ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 872467824 } })
32372024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32382024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32392024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32402024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32412024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32422024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32432024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32442024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32452024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32462024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32472024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32482024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32492024-08-28T23:33:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32502024-08-28T23:33:52.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32512024-08-28T23:33:52.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-08-28T23:33:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32532024-08-28T23:33:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.509634ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32542024-08-28T23:33:52.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32552024-08-28T23:33:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.546222ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32562024-08-28T23:33:52.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32572024-08-28T23:33:52.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32582024-08-28T23:33:52.095ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
32592024-08-28T23:33:52.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.991361ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
32602024-08-28T23:33:52.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 877495776 } })
32612024-08-28T23:33:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32622024-08-28T23:33:52.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32632024-08-28T23:33:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32642024-08-28T23:33:52.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
32652024-08-28T23:33:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32662024-08-28T23:33:52.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32672024-08-28T23:33:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32682024-08-28T23:33:52.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-08-28T23:33:52.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32702024-08-28T23:33:52.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32712024-08-28T23:33:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32722024-08-28T23:33:52.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32732024-08-28T23:33:52.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32742024-08-28T23:33:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32752024-08-28T23:33:52.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32762024-08-28T23:33:52.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 881499409 } })
32772024-08-28T23:33:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32782024-08-28T23:33:52.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
32792024-08-28T23:33:52.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32802024-08-28T23:33:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32812024-08-28T23:33:52.102ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32822024-08-28T23:33:52.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32832024-08-28T23:33:52.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32842024-08-28T23:33:52.103ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
32852024-08-28T23:33:52.103ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
32862024-08-28T23:33:52.103ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.888305ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
32872024-08-28T23:33:52.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882024-08-28T23:33:52.104ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:23:52.090456311 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32892024-08-28T23:33:52.104ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.640058ms iteration = 7 status = {"expiration":"2024-08-28T23:23:52.090456311Z","pruned":[]}
32902024-08-28T23:33:52.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32912024-08-28T23:33:52.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32922024-08-28T23:33:52.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32932024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32942024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32952024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32962024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32972024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32982024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32992024-08-28T23:33:52.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33002024-08-28T23:33:52.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33012024-08-28T23:33:52.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33022024-08-28T23:33:52.109ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.723852ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
33032024-08-28T23:33:52.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33042024-08-28T23:33:52.111ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33052024-08-28T23:33:52.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33062024-08-28T23:33:52.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33072024-08-28T23:33:52.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33082024-08-28T23:33:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33092024-08-28T23:33:52.114ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33102024-08-28T23:33:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33112024-08-28T23:33:52.114ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-08-28T23:33:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33132024-08-28T23:33:52.119ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33142024-08-28T23:33:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33152024-08-28T23:33:52.121ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33162024-08-28T23:33:52.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33172024-08-28T23:33:52.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33182024-08-28T23:33:52.124ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33192024-08-28T23:33:52.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33202024-08-28T23:33:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33212024-08-28T23:33:52.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33222024-08-28T23:33:52.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33232024-08-28T23:33:52.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33242024-08-28T23:33:52.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33252024-08-28T23:33:52.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33262024-08-28T23:33:52.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33272024-08-28T23:33:52.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33282024-08-28T23:33:52.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292024-08-28T23:33:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33302024-08-28T23:33:52.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33312024-08-28T23:33:52.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33322024-08-28T23:33:52.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33332024-08-28T23:33:52.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33342024-08-28T23:33:52.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33352024-08-28T23:33:52.135ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 916603578 } })
33362024-08-28T23:33:52.135ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
33372024-08-28T23:33:52.137ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33382024-08-28T23:33:52.137ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 47.090268ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33392024-08-28T23:33:52.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33402024-08-28T23:33:52.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33412024-08-28T23:33:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33422024-08-28T23:33:52.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33432024-08-28T23:33:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33442024-08-28T23:33:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33452024-08-28T23:33:52.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33462024-08-28T23:33:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33472024-08-28T23:33:52.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.480253ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
33482024-08-28T23:33:52.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33492024-08-28T23:33:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33502024-08-28T23:33:52.154ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33512024-08-28T23:33:52.154ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33522024-08-28T23:33:52.154ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33532024-08-28T23:33:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33542024-08-28T23:33:52.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33552024-08-28T23:33:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33562024-08-28T23:33:52.163ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33572024-08-28T23:33:52.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33582024-08-28T23:33:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33592024-08-28T23:33:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33602024-08-28T23:33:52.164ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33612024-08-28T23:33:52.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33622024-08-28T23:33:52.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.561178ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33632024-08-28T23:33:52.171ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33642024-08-28T23:33:52.171ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33652024-08-28T23:33:52.171ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33662024-08-28T23:33:52.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33672024-08-28T23:33:52.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33682024-08-28T23:33:52.176ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33692024-08-28T23:33:52.176ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33702024-08-28T23:33:52.176ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33712024-08-28T23:33:52.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33722024-08-28T23:33:52.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33732024-08-28T23:33:52.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742024-08-28T23:33:52.177ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-08-28T23:33:52.177ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33762024-08-28T23:33:52.177ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33772024-08-28T23:33:52.177ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.494025ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33782024-08-28T23:33:52.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33792024-08-28T23:33:52.180ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33802024-08-28T23:33:52.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33812024-08-28T23:33:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
33822024-08-28T23:33:52.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33832024-08-28T23:33:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33842024-08-28T23:33:52.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33852024-08-28T23:33:52.295ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33862024-08-28T23:33:52.300ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33872024-08-28T23:33:52.300ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33882024-08-28T23:33:52.300ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
33892024-08-28T23:33:52.300ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33902024-08-28T23:33:52.300ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "397790f9-af1f-44c1-8afb-dd0282100a40", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
33912024-08-28T23:33:52.300ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33922024-08-28T23:33:52.300ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "482e8078-1dd7-4547-a892-fedb8e723b0a", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
33932024-08-28T23:33:52.300ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33942024-08-28T23:33:52.301ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33952024-08-28T23:33:52.301ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33962024-08-28T23:33:52.301ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4aac2f57-77df-4dd2-9516-2f6fc9afd793", "content-length": "26", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
33972024-08-28T23:33:52.301ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33982024-08-28T23:33:52.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33992024-08-28T23:33:52.305ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
34002024-08-28T23:33:52.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34012024-08-28T23:33:52.490ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34022024-08-28T23:33:52.521ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 431.590323ms iteration = 13 status = {}
34032024-08-28T23:33:52.575ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34042024-08-28T23:33:52.576ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "199dfdac-c191-455b-935c-5b02697c2641", "content-length": "372", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34052024-08-28T23:33:52.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34062024-08-28T23:33:52.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34072024-08-28T23:33:52.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34082024-08-28T23:33:52.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34092024-08-28T23:33:52.584ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 494.686533ms iteration = 4 status = {"nsuccess":5}
34102024-08-28T23:33:52.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34112024-08-28T23:33:52.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34122024-08-28T23:33:52.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34132024-08-28T23:33:52.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34142024-08-28T23:33:52.594ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34152024-08-28T23:33:52.594ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a106b6a-cadc-48b5-91ec-a51fb398f321", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34162024-08-28T23:33:52.596ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 505.898597ms iteration = 13 status = {}
34172024-08-28T23:33:52.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
34182024-08-28T23:33:52.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 508.913782ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
34192024-08-28T23:33:52.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34202024-08-28T23:33:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34212024-08-28T23:33:52.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 528.681082ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
34222024-08-28T23:33:52.619ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
34232024-08-28T23:33:52.619ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34242024-08-28T23:33:52.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 528.979048ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
34252024-08-28T23:33:52.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 529.092289ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34262024-08-28T23:33:52.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34272024-08-28T23:33:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34282024-08-28T23:33:52.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34292024-08-28T23:33:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34302024-08-28T23:33:52.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34312024-08-28T23:33:52.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322024-08-28T23:33:52.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-08-28T23:33:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34342024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
34352024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34362024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34372024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34382024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34392024-08-28T23:33:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34402024-08-28T23:33:52.632ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34412024-08-28T23:33:52.632ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9b58e6-1627-42af-89bc-8dccad43d3d7", "content-length": "1", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34422024-08-28T23:33:52.632ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 542.120496ms iteration = 13 status = 0
34432024-08-28T23:33:52.635ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34442024-08-28T23:33:52.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34452024-08-28T23:33:52.637ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 547.021326ms iteration = 13 status = null
34462024-08-28T23:33:52.643ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34472024-08-28T23:33:52.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80aa5a4f-b6f2-43e7-b22e-f5e9f54de6e3", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34482024-08-28T23:33:52.643ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34492024-08-28T23:33:52.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34502024-08-28T23:33:52.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6ea79723-dc6f-4a6d-ac4f-067e3760eeca", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34512024-08-28T23:33:52.645ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34522024-08-28T23:33:52.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fea381dd-0f60-4155-ad26-9a76827d63ca", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34532024-08-28T23:33:52.646ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34542024-08-28T23:33:52.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34552024-08-28T23:33:52.647ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 557.497187ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34562024-08-28T23:33:52.648ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5eaeb395-bbfe-45e4-b113-5732eb109bb6", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34572024-08-28T23:33:52.648ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34582024-08-28T23:33:52.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592024-08-28T23:33:52.650ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3e020d38-463a-42ed-a711-b12b98cb3f3d", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34602024-08-28T23:33:52.650ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34612024-08-28T23:33:52.652ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
34622024-08-28T23:33:52.652ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.252654ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34632024-08-28T23:33:52.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34642024-08-28T23:33:52.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34652024-08-28T23:33:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34662024-08-28T23:33:52.655ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34672024-08-28T23:33:52.655ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
34682024-08-28T23:33:52.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34692024-08-28T23:33:52.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34702024-08-28T23:33:52.658ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34712024-08-28T23:33:52.658ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34722024-08-28T23:33:52.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34732024-08-28T23:33:52.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34742024-08-28T23:33:52.660ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
34752024-08-28T23:33:52.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 570.246439ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34762024-08-28T23:33:52.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34772024-08-28T23:33:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34782024-08-28T23:33:52.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
34792024-08-28T23:33:52.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34802024-08-28T23:33:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34812024-08-28T23:33:52.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 584.670103ms iteration = 15 status = {"physical_disks_added":0}
34822024-08-28T23:33:52.678ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34832024-08-28T23:33:52.678ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cf1bfd8-0195-4e9b-bbf0-cfc6aac0460c", "content-length": "121", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34842024-08-28T23:33:52.678ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
34852024-08-28T23:33:52.678ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
34862024-08-28T23:33:52.679ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34872024-08-28T23:33:52.679ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34882024-08-28T23:33:52.679ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
34892024-08-28T23:33:52.679ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
34902024-08-28T23:33:52.679ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
34912024-08-28T23:33:52.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34922024-08-28T23:33:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34932024-08-28T23:33:52.681ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34942024-08-28T23:33:52.681ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70e773e8-66c0-4ce5-bded-1d6b090a3f49", "content-length": "2", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34952024-08-28T23:33:52.681ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34962024-08-28T23:33:52.681ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a20e6c94-56e7-4310-8b62-52818f533d42", "content-length": "52", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
34972024-08-28T23:33:52.681ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
34982024-08-28T23:33:52.681ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34992024-08-28T23:33:52.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35002024-08-28T23:33:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35012024-08-28T23:33:52.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35022024-08-28T23:33:52.683ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
35032024-08-28T23:33:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 593.741027ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35042024-08-28T23:33:52.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35052024-08-28T23:33:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35062024-08-28T23:33:52.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35072024-08-28T23:33:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35082024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
35092024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35102024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
35112024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 598.227959ms iteration = 7 status = {"generation":2}
35122024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35132024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35142024-08-28T23:33:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35152024-08-28T23:33:52.691ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
35162024-08-28T23:33:52.691ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35172024-08-28T23:33:52.691ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
35182024-08-28T23:33:52.691ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 601.203103ms iteration = 7 status = {"generation":1}
35192024-08-28T23:33:52.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35202024-08-28T23:33:52.710ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35212024-08-28T23:33:52.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35222024-08-28T23:33:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35232024-08-28T23:33:52.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35242024-08-28T23:33:52.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35252024-08-28T23:33:52.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35262024-08-28T23:33:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35272024-08-28T23:33:52.781ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "286d9234-a811-4bde-b480-987780556bf8", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
35282024-08-28T23:33:52.781ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
35292024-08-28T23:33:52.781ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35302024-08-28T23:33:52.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35312024-08-28T23:33:52.816ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 429 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 4ec98428-9095-4a35-805d-f315f67dcda3 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
35322024-08-28T23:33:52.818ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
35332024-08-28T23:33:52.818ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
35342024-08-28T23:33:52.851ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
35352024-08-28T23:33:52.851ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:48056
35362024-08-28T23:33:52.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48056 req_id = 97294066-70af-42b1-8c35-58554c146190 roles = RoleSet { roles: {} } uri = /metrics/producers
35372024-08-28T23:33:52.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48056 req_id = 97294066-70af-42b1-8c35-58554c146190 resource = Database result = Ok(()) uri = /metrics/producers
35382024-08-28T23:33:52.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a7cb813-2fb0-4ff2-b532-d04f910868d3", "content-length": "667", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
35392024-08-28T23:33:52.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35402024-08-28T23:33:52.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35412024-08-28T23:33:52.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d04aa80d-1155-4c8d-92fa-a36fd34783f2", "content-length": "691", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
35422024-08-28T23:33:52.881ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35432024-08-28T23:33:52.881ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35442024-08-28T23:33:52.881ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35452024-08-28T23:33:52.883ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 793.021117ms iteration = 13 status = {}
35462024-08-28T23:33:52.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35472024-08-28T23:33:52.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35482024-08-28T23:33:52.886ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 099a839b-4790-447a-827a-80c4d38e82a0
35492024-08-28T23:33:52.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48056 req_id = 97294066-70af-42b1-8c35-58554c146190 roles = RoleSet { roles: {} } uri = /metrics/producers
35502024-08-28T23:33:52.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48056 req_id = 97294066-70af-42b1-8c35-58554c146190 resource = Database result = Ok(()) uri = /metrics/producers
35512024-08-28T23:33:52.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35522024-08-28T23:33:52.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35532024-08-28T23:33:52.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35542024-08-28T23:33:52.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35552024-08-28T23:33:52.898ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.609713ms iteration = 13 status = {}
35562024-08-28T23:33:52.926ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 uri = http://[fd00:1122:3344:101::d]:12223/producers
35572024-08-28T23:33:52.926ZDEBGnexus: client response oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "116748be-e6cc-470b-b4c5-1dc9b91ada0f", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
35582024-08-28T23:33:52.926ZINFOnexus: assigned collector to new producer collector_id = 099a839b-4790-447a-827a-80c4d38e82a0 file = nexus/src/app/oximeter.rs:125 producer_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
35592024-08-28T23:33:52.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 77362 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48056 req_id = 97294066-70af-42b1-8c35-58554c146190 response_code = 201 uri = /metrics/producers
35602024-08-28T23:33:52.928ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "97294066-70af-42b1-8c35-58554c146190", "content-length": "41", "date": "Wed, 28 Aug 2024 23:33:52 GMT"} })
35612024-08-28T23:33:52.930ZDEBGnexus (producer-registration-task): registered with nexus successfully
35622024-08-28T23:33:52.930ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
35632024-08-28T23:33:53.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e4afaef-f2d9-4e42-bdc6-33d23eb679fc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35642024-08-28T23:33:53.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e4afaef-f2d9-4e42-bdc6-33d23eb679fc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35652024-08-28T23:33:53.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e4afaef-f2d9-4e42-bdc6-33d23eb679fc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35662024-08-28T23:33:54.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0138b13-4c86-44d7-b44b-a983b3738b1f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35672024-08-28T23:33:54.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0138b13-4c86-44d7-b44b-a983b3738b1f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35682024-08-28T23:33:54.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e0138b13-4c86-44d7-b44b-a983b3738b1f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35692024-08-28T23:33:55.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 249cfb14-5aed-4f5a-b00a-d816b10e512e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35702024-08-28T23:33:55.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 249cfb14-5aed-4f5a-b00a-d816b10e512e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35712024-08-28T23:33:55.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 249cfb14-5aed-4f5a-b00a-d816b10e512e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35722024-08-28T23:33:56.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cc83e50f-2f24-457e-a3f0-6d5a4496de01 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35732024-08-28T23:33:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cc83e50f-2f24-457e-a3f0-6d5a4496de01 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35742024-08-28T23:33:56.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cc83e50f-2f24-457e-a3f0-6d5a4496de01 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35752024-08-28T23:33:57.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eaa17299-9ec7-4a21-87e2-f438ac487568 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35762024-08-28T23:33:57.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eaa17299-9ec7-4a21-87e2-f438ac487568 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35772024-08-28T23:33:57.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eaa17299-9ec7-4a21-87e2-f438ac487568 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35782024-08-28T23:33:58.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 553537ff-877c-43cc-b672-11a4655b6a97 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35792024-08-28T23:33:58.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 553537ff-877c-43cc-b672-11a4655b6a97 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35802024-08-28T23:33:58.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 553537ff-877c-43cc-b672-11a4655b6a97 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35812024-08-28T23:33:59.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96405546-713f-456b-92df-910ab9771de4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35822024-08-28T23:33:59.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96405546-713f-456b-92df-910ab9771de4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35832024-08-28T23:33:59.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96405546-713f-456b-92df-910ab9771de4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35842024-08-28T23:34:00.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f0476941-4e77-4ce2-8b4a-ac1ba0d570bc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35852024-08-28T23:34:00.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f0476941-4e77-4ce2-8b4a-ac1ba0d570bc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35862024-08-28T23:34:00.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f0476941-4e77-4ce2-8b4a-ac1ba0d570bc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35872024-08-28T23:34:01.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 71efab2e-27f4-4b06-8426-15457e05e63d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35882024-08-28T23:34:01.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 71efab2e-27f4-4b06-8426-15457e05e63d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35892024-08-28T23:34:01.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 71efab2e-27f4-4b06-8426-15457e05e63d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
35902024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
35912024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35922024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35932024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
35942024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35952024-08-28T23:34:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35962024-08-28T23:34:02.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972024-08-28T23:34:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35982024-08-28T23:34:02.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35992024-08-28T23:34:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36002024-08-28T23:34:02.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36012024-08-28T23:34:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36022024-08-28T23:34:02.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36032024-08-28T23:34:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36042024-08-28T23:34:02.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052024-08-28T23:34:02.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
36062024-08-28T23:34:02.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36072024-08-28T23:34:02.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36082024-08-28T23:34:02.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
36092024-08-28T23:34:02.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.141024ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
36102024-08-28T23:34:02.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.397115ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36112024-08-28T23:34:02.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c81f5e9-3f61-46ac-83e5-23980c226d99 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36122024-08-28T23:34:02.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c81f5e9-3f61-46ac-83e5-23980c226d99 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36132024-08-28T23:34:02.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c81f5e9-3f61-46ac-83e5-23980c226d99 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36142024-08-28T23:34:02.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 686 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 0f1ce4a6-9f1e-42ae-b438-74c6a44e0e48 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
36152024-08-28T23:34:03.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7997a24-acce-4378-b3c9-7af03d35ebc4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36162024-08-28T23:34:03.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7997a24-acce-4378-b3c9-7af03d35ebc4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36172024-08-28T23:34:03.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e7997a24-acce-4378-b3c9-7af03d35ebc4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36182024-08-28T23:34:04.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 005e65be-065d-4a3a-a1ba-5a27c249011d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36192024-08-28T23:34:04.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 005e65be-065d-4a3a-a1ba-5a27c249011d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36202024-08-28T23:34:04.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 005e65be-065d-4a3a-a1ba-5a27c249011d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36212024-08-28T23:34:05.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0844e42a-5bbf-4a0f-b184-f931a4a63c42 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36222024-08-28T23:34:05.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0844e42a-5bbf-4a0f-b184-f931a4a63c42 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36232024-08-28T23:34:05.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0844e42a-5bbf-4a0f-b184-f931a4a63c42 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36242024-08-28T23:34:06.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9d90bcf-867b-4e47-811c-a2bdad18e66e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36252024-08-28T23:34:06.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9d90bcf-867b-4e47-811c-a2bdad18e66e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36262024-08-28T23:34:06.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9d90bcf-867b-4e47-811c-a2bdad18e66e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36272024-08-28T23:34:07.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34a2d616-f35b-4169-bc4c-b4c02ba53e16 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36282024-08-28T23:34:07.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34a2d616-f35b-4169-bc4c-b4c02ba53e16 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36292024-08-28T23:34:07.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34a2d616-f35b-4169-bc4c-b4c02ba53e16 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36302024-08-28T23:34:08.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2be19da-0a9e-4c55-acc4-fcc9645d44c0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36312024-08-28T23:34:08.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2be19da-0a9e-4c55-acc4-fcc9645d44c0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36322024-08-28T23:34:08.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2be19da-0a9e-4c55-acc4-fcc9645d44c0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36332024-08-28T23:34:09.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 01bd2a45-55a4-40cc-8aee-5be20385ee2f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36342024-08-28T23:34:09.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 01bd2a45-55a4-40cc-8aee-5be20385ee2f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36352024-08-28T23:34:09.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 01bd2a45-55a4-40cc-8aee-5be20385ee2f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36362024-08-28T23:34:10.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1caa6ac2-f81f-44b0-83d7-ac8bbda0e1eb roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36372024-08-28T23:34:10.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1caa6ac2-f81f-44b0-83d7-ac8bbda0e1eb resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36382024-08-28T23:34:10.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1caa6ac2-f81f-44b0-83d7-ac8bbda0e1eb response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36392024-08-28T23:34:11.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f75de28-e37a-4f8b-a199-f74e9ad1d2c1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36402024-08-28T23:34:11.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f75de28-e37a-4f8b-a199-f74e9ad1d2c1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36412024-08-28T23:34:11.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f75de28-e37a-4f8b-a199-f74e9ad1d2c1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36422024-08-28T23:34:12.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
36432024-08-28T23:34:12.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36442024-08-28T23:34:12.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36452024-08-28T23:34:12.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-08-28T23:34:12.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
36472024-08-28T23:34:12.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36482024-08-28T23:34:12.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36492024-08-28T23:34:12.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36502024-08-28T23:34:12.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36512024-08-28T23:34:12.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36522024-08-28T23:34:12.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36532024-08-28T23:34:12.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36542024-08-28T23:34:12.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552024-08-28T23:34:12.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
36562024-08-28T23:34:12.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36572024-08-28T23:34:12.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36582024-08-28T23:34:12.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
36592024-08-28T23:34:12.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.697635ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
36602024-08-28T23:34:12.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36612024-08-28T23:34:12.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36622024-08-28T23:34:12.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.093242ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36632024-08-28T23:34:12.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ec081ea-8991-4622-ac1d-18d5a373f89c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36642024-08-28T23:34:12.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ec081ea-8991-4622-ac1d-18d5a373f89c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36652024-08-28T23:34:12.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ec081ea-8991-4622-ac1d-18d5a373f89c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36662024-08-28T23:34:12.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 0810ac72-4635-41ed-a974-009479962ffb response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
36672024-08-28T23:34:13.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9754cec-9a55-4b52-a283-0f22f150447a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36682024-08-28T23:34:13.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9754cec-9a55-4b52-a283-0f22f150447a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36692024-08-28T23:34:13.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9754cec-9a55-4b52-a283-0f22f150447a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36702024-08-28T23:34:14.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ebbf1278-729c-4729-80ae-b3d7007c1073 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36712024-08-28T23:34:14.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ebbf1278-729c-4729-80ae-b3d7007c1073 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36722024-08-28T23:34:14.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ebbf1278-729c-4729-80ae-b3d7007c1073 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36732024-08-28T23:34:15.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 632637d0-4d40-4716-811a-71e2faf04da1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36742024-08-28T23:34:15.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 632637d0-4d40-4716-811a-71e2faf04da1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36752024-08-28T23:34:15.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 632637d0-4d40-4716-811a-71e2faf04da1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36762024-08-28T23:34:16.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d902fd10-42f9-4933-92c8-dcfe90442b67 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36772024-08-28T23:34:16.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d902fd10-42f9-4933-92c8-dcfe90442b67 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36782024-08-28T23:34:16.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d902fd10-42f9-4933-92c8-dcfe90442b67 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36792024-08-28T23:34:17.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7f65942-c606-4635-92e5-1e80f5ed3589 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36802024-08-28T23:34:17.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7f65942-c606-4635-92e5-1e80f5ed3589 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36812024-08-28T23:34:17.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7f65942-c606-4635-92e5-1e80f5ed3589 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36822024-08-28T23:34:18.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = abe06621-4c58-4972-bc01-5c7d9c4c5dcc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36832024-08-28T23:34:18.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = abe06621-4c58-4972-bc01-5c7d9c4c5dcc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36842024-08-28T23:34:18.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = abe06621-4c58-4972-bc01-5c7d9c4c5dcc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36852024-08-28T23:34:19.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8dd8167-8049-486b-99b7-fb9b639c419f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36862024-08-28T23:34:19.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8dd8167-8049-486b-99b7-fb9b639c419f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36872024-08-28T23:34:19.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f8dd8167-8049-486b-99b7-fb9b639c419f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36882024-08-28T23:34:20.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198945b1-4bae-4e4b-8c9f-095890360f6c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36892024-08-28T23:34:20.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198945b1-4bae-4e4b-8c9f-095890360f6c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36902024-08-28T23:34:20.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198945b1-4bae-4e4b-8c9f-095890360f6c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36912024-08-28T23:34:21.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f2c80e4-d457-4336-b439-4cac435badcc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36922024-08-28T23:34:21.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f2c80e4-d457-4336-b439-4cac435badcc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36932024-08-28T23:34:21.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0f2c80e4-d457-4336-b439-4cac435badcc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
36942024-08-28T23:34:22.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
36952024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
36962024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36972024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
36982024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36992024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
37002024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
37012024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37022024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37032024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37042024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37052024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37062024-08-28T23:34:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37072024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
37082024-08-28T23:34:22.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
37092024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
37102024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37112024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37122024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
37132024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37142024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
37152024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37162024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
37172024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37182024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
37192024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
37202024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37212024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37222024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37232024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
37242024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37252024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
37262024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
37272024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37282024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37292024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
37302024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37312024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37322024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37332024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37342024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37352024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37362024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37372024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37382024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37392024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37402024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37412024-08-28T23:34:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37422024-08-28T23:34:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 874666114 } })
37432024-08-28T23:34:22.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37442024-08-28T23:34:22.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.174616ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37452024-08-28T23:34:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
37462024-08-28T23:34:22.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37472024-08-28T23:34:22.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 876468447 } })
37482024-08-28T23:34:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37492024-08-28T23:34:22.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37502024-08-28T23:34:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37512024-08-28T23:34:22.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
37522024-08-28T23:34:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37532024-08-28T23:34:22.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37542024-08-28T23:34:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37552024-08-28T23:34:22.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37562024-08-28T23:34:22.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37572024-08-28T23:34:22.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37582024-08-28T23:34:22.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37592024-08-28T23:34:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37602024-08-28T23:34:22.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37612024-08-28T23:34:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37622024-08-28T23:34:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37632024-08-28T23:34:22.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37642024-08-28T23:34:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37652024-08-28T23:34:22.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37662024-08-28T23:34:22.106ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 887498998 } })
37672024-08-28T23:34:22.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37682024-08-28T23:34:22.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37692024-08-28T23:34:22.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-08-28T23:34:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37712024-08-28T23:34:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37722024-08-28T23:34:22.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
37732024-08-28T23:34:22.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37742024-08-28T23:34:22.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.904374ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
37752024-08-28T23:34:22.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37762024-08-28T23:34:22.133ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37772024-08-28T23:34:22.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37782024-08-28T23:34:22.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37792024-08-28T23:34:22.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37802024-08-28T23:34:22.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37812024-08-28T23:34:22.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37822024-08-28T23:34:22.138ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
37832024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37842024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37852024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37862024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37872024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37882024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37892024-08-28T23:34:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37902024-08-28T23:34:22.140ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37912024-08-28T23:34:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37922024-08-28T23:34:22.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37932024-08-28T23:34:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37942024-08-28T23:34:22.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37952024-08-28T23:34:22.142ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37962024-08-28T23:34:22.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.356676ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37972024-08-28T23:34:22.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982024-08-28T23:34:22.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.723583ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37992024-08-28T23:34:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
38002024-08-28T23:34:22.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38012024-08-28T23:34:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38022024-08-28T23:34:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38032024-08-28T23:34:22.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-08-28T23:34:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-08-28T23:34:22.146ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.686664ms iteration = 14 status = 0
38062024-08-28T23:34:22.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072024-08-28T23:34:22.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38082024-08-28T23:34:22.154ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38092024-08-28T23:34:22.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38102024-08-28T23:34:22.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38112024-08-28T23:34:22.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38122024-08-28T23:34:22.178ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.898004ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38132024-08-28T23:34:22.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38142024-08-28T23:34:22.179ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38152024-08-28T23:34:22.179ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "43f0435a-4011-44c1-90c5-0c383cb20ca9", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38162024-08-28T23:34:22.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38172024-08-28T23:34:22.180ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38182024-08-28T23:34:22.180ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38192024-08-28T23:34:22.180ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.017232ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
38202024-08-28T23:34:22.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38212024-08-28T23:34:22.181ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38222024-08-28T23:34:22.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38232024-08-28T23:34:22.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.639888ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
38242024-08-28T23:34:22.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38252024-08-28T23:34:22.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
38262024-08-28T23:34:22.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-08-28T23:34:22.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38282024-08-28T23:34:22.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
38292024-08-28T23:34:22.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.145352ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
38302024-08-28T23:34:22.220ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
38312024-08-28T23:34:22.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.088352ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38322024-08-28T23:34:22.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38332024-08-28T23:34:22.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38342024-08-28T23:34:22.267ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.345721ms iteration = 16 status = {"physical_disks_added":0}
38352024-08-28T23:34:22.274ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38362024-08-28T23:34:22.274ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38372024-08-28T23:34:22.274ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a9aa1145-887b-45c2-9d0d-efc715be9c29", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38382024-08-28T23:34:22.274ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38392024-08-28T23:34:22.276ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38402024-08-28T23:34:22.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
38412024-08-28T23:34:22.297ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38422024-08-28T23:34:22.297ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bcffb2e6-006a-43c1-a4ae-26344f119ea1", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38432024-08-28T23:34:22.297ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38442024-08-28T23:34:22.299ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
38452024-08-28T23:34:22.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38462024-08-28T23:34:22.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1b532e7a-9590-44f9-8902-43101a58a145", "content-length": "372", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38472024-08-28T23:34:22.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38482024-08-28T23:34:22.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38492024-08-28T23:34:22.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38502024-08-28T23:34:22.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38512024-08-28T23:34:22.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38522024-08-28T23:34:22.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38532024-08-28T23:34:22.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38542024-08-28T23:34:22.314ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9363a053-5035-4ab2-b3b2-8b13bcab9dcc", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38552024-08-28T23:34:22.315ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.760375ms iteration = 14 status = {}
38562024-08-28T23:34:22.320ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.662803ms iteration = 14 status = {}
38572024-08-28T23:34:22.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38582024-08-28T23:34:22.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38592024-08-28T23:34:22.387ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38602024-08-28T23:34:22.387ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3db94ad8-91b5-47bf-8b33-d636be5a23f2", "content-length": "1", "date": "Wed, 28 Aug 2024 23:34:21 GMT"} })
38612024-08-28T23:34:22.389ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38622024-08-28T23:34:22.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38632024-08-28T23:34:22.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38642024-08-28T23:34:22.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38652024-08-28T23:34:22.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38662024-08-28T23:34:22.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38672024-08-28T23:34:22.393ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.208854ms iteration = 14 status = null
38682024-08-28T23:34:22.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38692024-08-28T23:34:22.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38702024-08-28T23:34:22.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38712024-08-28T23:34:22.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38722024-08-28T23:34:22.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38732024-08-28T23:34:22.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38742024-08-28T23:34:22.474ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
38752024-08-28T23:34:22.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38762024-08-28T23:34:22.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38772024-08-28T23:34:22.484ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38782024-08-28T23:34:22.485ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38792024-08-28T23:34:22.485ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10164de2-9808-4e6a-ba62-804cc8c55d5f", "content-length": "121", "date": "Wed, 28 Aug 2024 23:34:21 GMT"} })
38802024-08-28T23:34:22.485ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
38812024-08-28T23:34:22.485ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
38822024-08-28T23:34:22.486ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38832024-08-28T23:34:22.486ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38842024-08-28T23:34:22.486ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
38852024-08-28T23:34:22.486ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
38862024-08-28T23:34:22.486ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
38872024-08-28T23:34:22.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38882024-08-28T23:34:22.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38892024-08-28T23:34:22.488ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38902024-08-28T23:34:22.488ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9147e6e-4565-4951-afe0-e84b4b7600c2", "content-length": "2", "date": "Wed, 28 Aug 2024 23:34:21 GMT"} })
38912024-08-28T23:34:22.488ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38922024-08-28T23:34:22.488ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d320368-76f6-4385-9285-c77b5f77c584", "content-length": "52", "date": "Wed, 28 Aug 2024 23:34:21 GMT"} })
38932024-08-28T23:34:22.488ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
38942024-08-28T23:34:22.488ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38952024-08-28T23:34:22.515ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e2cca000-a08f-4d3b-acc3-d7d4fab8bdfd", "content-length": "691", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
38962024-08-28T23:34:22.515ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38972024-08-28T23:34:22.515ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38982024-08-28T23:34:22.515ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38992024-08-28T23:34:22.517ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 426.245276ms iteration = 14 status = {}
39002024-08-28T23:34:22.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9edc581c-e93d-4157-aa2c-21590d92aa67", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
39012024-08-28T23:34:22.604ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
39022024-08-28T23:34:22.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39032024-08-28T23:34:22.608ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c5aeece-58d4-45a4-81f1-0bc804a41883", "content-length": "667", "date": "Wed, 28 Aug 2024 23:34:22 GMT"} })
39042024-08-28T23:34:22.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39052024-08-28T23:34:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39062024-08-28T23:34:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39072024-08-28T23:34:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39082024-08-28T23:34:22.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39092024-08-28T23:34:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39102024-08-28T23:34:22.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39112024-08-28T23:34:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39122024-08-28T23:34:22.625ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.106721ms iteration = 14 status = {}
39132024-08-28T23:34:22.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b95118ea-5034-43e5-bed1-4d72116d0891 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39142024-08-28T23:34:22.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b95118ea-5034-43e5-bed1-4d72116d0891 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39152024-08-28T23:34:22.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b95118ea-5034-43e5-bed1-4d72116d0891 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39162024-08-28T23:34:22.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = a8631879-2e79-41ac-a00d-877f57f0c753 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
39172024-08-28T23:34:23.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aa586c85-0bb2-4745-89bc-fa95f28b6e1e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39182024-08-28T23:34:23.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aa586c85-0bb2-4745-89bc-fa95f28b6e1e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39192024-08-28T23:34:23.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aa586c85-0bb2-4745-89bc-fa95f28b6e1e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39202024-08-28T23:34:24.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 081f6db0-7ce1-4698-9380-75c88a246ac8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39212024-08-28T23:34:24.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 081f6db0-7ce1-4698-9380-75c88a246ac8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39222024-08-28T23:34:24.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 081f6db0-7ce1-4698-9380-75c88a246ac8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39232024-08-28T23:34:25.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25d3657b-3893-448f-b427-43daf766c654 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39242024-08-28T23:34:25.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25d3657b-3893-448f-b427-43daf766c654 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39252024-08-28T23:34:25.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 25d3657b-3893-448f-b427-43daf766c654 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39262024-08-28T23:34:26.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b74c8311-7f80-4ed7-9426-788cd40abede roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39272024-08-28T23:34:26.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b74c8311-7f80-4ed7-9426-788cd40abede resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39282024-08-28T23:34:26.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b74c8311-7f80-4ed7-9426-788cd40abede response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39292024-08-28T23:34:27.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5647022-5cba-494d-ad54-7f1de04d735d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39302024-08-28T23:34:27.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5647022-5cba-494d-ad54-7f1de04d735d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39312024-08-28T23:34:27.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f5647022-5cba-494d-ad54-7f1de04d735d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39322024-08-28T23:34:28.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 32490ee7-bd0a-4636-a443-50df4a04faa1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39332024-08-28T23:34:28.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 32490ee7-bd0a-4636-a443-50df4a04faa1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39342024-08-28T23:34:28.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 32490ee7-bd0a-4636-a443-50df4a04faa1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39352024-08-28T23:34:29.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d44b2fd0-05b9-40c0-804d-67af43fbf1a0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39362024-08-28T23:34:29.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d44b2fd0-05b9-40c0-804d-67af43fbf1a0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39372024-08-28T23:34:29.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d44b2fd0-05b9-40c0-804d-67af43fbf1a0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39382024-08-28T23:34:30.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7ac076e-d635-4442-98e2-4914ee7903cc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39392024-08-28T23:34:30.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7ac076e-d635-4442-98e2-4914ee7903cc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39402024-08-28T23:34:30.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b7ac076e-d635-4442-98e2-4914ee7903cc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39412024-08-28T23:34:31.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5a3c8df4-3258-4bdf-9f89-ae34b5483818 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39422024-08-28T23:34:31.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5a3c8df4-3258-4bdf-9f89-ae34b5483818 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39432024-08-28T23:34:31.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5a3c8df4-3258-4bdf-9f89-ae34b5483818 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39442024-08-28T23:34:32.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
39452024-08-28T23:34:32.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39462024-08-28T23:34:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39472024-08-28T23:34:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
39482024-08-28T23:34:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39492024-08-28T23:34:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39502024-08-28T23:34:32.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39512024-08-28T23:34:32.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39522024-08-28T23:34:32.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39532024-08-28T23:34:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39542024-08-28T23:34:32.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39552024-08-28T23:34:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39562024-08-28T23:34:32.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39572024-08-28T23:34:32.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39582024-08-28T23:34:32.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-08-28T23:34:32.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
39602024-08-28T23:34:32.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39612024-08-28T23:34:32.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39622024-08-28T23:34:32.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
39632024-08-28T23:34:32.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.624699ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
39642024-08-28T23:34:32.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.924871ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39652024-08-28T23:34:32.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 405 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 1273e2c2-b1d8-45a0-8557-ed85c1773acc response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
39662024-08-28T23:34:32.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a2887e4e-280a-4caa-934d-26b25d543d28 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39672024-08-28T23:34:32.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a2887e4e-280a-4caa-934d-26b25d543d28 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39682024-08-28T23:34:32.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a2887e4e-280a-4caa-934d-26b25d543d28 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39692024-08-28T23:34:33.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f25190f-896b-4ab9-995d-56d8f6c79ccd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39702024-08-28T23:34:33.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f25190f-896b-4ab9-995d-56d8f6c79ccd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39712024-08-28T23:34:33.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1f25190f-896b-4ab9-995d-56d8f6c79ccd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39722024-08-28T23:34:34.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b350dd-c4d0-4480-a046-4b90e4c45b0b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39732024-08-28T23:34:34.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b350dd-c4d0-4480-a046-4b90e4c45b0b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39742024-08-28T23:34:34.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67b350dd-c4d0-4480-a046-4b90e4c45b0b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39752024-08-28T23:34:35.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1923f55f-1a58-4082-be3c-922247aac844 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39762024-08-28T23:34:35.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1923f55f-1a58-4082-be3c-922247aac844 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39772024-08-28T23:34:36.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1923f55f-1a58-4082-be3c-922247aac844 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39782024-08-28T23:34:36.921ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1ca086f8-e7f3-4216-96af-38f3e9735b47 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-28T23:34:36.905850068Z }
39792024-08-28T23:34:36.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1ca086f8-e7f3-4216-96af-38f3e9735b47 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39802024-08-28T23:34:36.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1ca086f8-e7f3-4216-96af-38f3e9735b47 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39812024-08-28T23:34:36.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68454 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1ca086f8-e7f3-4216-96af-38f3e9735b47 response_code = 204 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39822024-08-28T23:34:36.975ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 379f8115-a53a-4a98-9ba4-6a50f9e411e6 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-28T23:34:36.974794094Z }
39832024-08-28T23:34:36.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 379f8115-a53a-4a98-9ba4-6a50f9e411e6 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39842024-08-28T23:34:36.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 379f8115-a53a-4a98-9ba4-6a50f9e411e6 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39852024-08-28T23:34:37.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 35031 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 379f8115-a53a-4a98-9ba4-6a50f9e411e6 response_code = 204 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
39862024-08-28T23:34:37.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ce5418-3ad3-4b48-bd8c-667e81167c7c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39872024-08-28T23:34:37.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ce5418-3ad3-4b48-bd8c-667e81167c7c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39882024-08-28T23:34:37.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e6ce5418-3ad3-4b48-bd8c-667e81167c7c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39892024-08-28T23:34:38.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 834e025e-7d8b-4b96-92f2-9fbf048a43b1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39902024-08-28T23:34:38.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 834e025e-7d8b-4b96-92f2-9fbf048a43b1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39912024-08-28T23:34:38.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 834e025e-7d8b-4b96-92f2-9fbf048a43b1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39922024-08-28T23:34:39.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5f30893a-2c11-49e9-8891-53ee07d37f94 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39932024-08-28T23:34:39.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5f30893a-2c11-49e9-8891-53ee07d37f94 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39942024-08-28T23:34:39.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5f30893a-2c11-49e9-8891-53ee07d37f94 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39952024-08-28T23:34:40.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33296fea-c997-4ac5-a7bc-75b5ae16322c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39962024-08-28T23:34:40.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33296fea-c997-4ac5-a7bc-75b5ae16322c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39972024-08-28T23:34:40.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33296fea-c997-4ac5-a7bc-75b5ae16322c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39982024-08-28T23:34:41.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4918b1ad-610e-41f6-ad93-6a7c4b17e00d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
39992024-08-28T23:34:41.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4918b1ad-610e-41f6-ad93-6a7c4b17e00d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40002024-08-28T23:34:41.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4918b1ad-610e-41f6-ad93-6a7c4b17e00d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40012024-08-28T23:34:42.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
40022024-08-28T23:34:42.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40032024-08-28T23:34:42.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40042024-08-28T23:34:42.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
40052024-08-28T23:34:42.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40062024-08-28T23:34:42.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40072024-08-28T23:34:42.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082024-08-28T23:34:42.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40092024-08-28T23:34:42.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40102024-08-28T23:34:42.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40112024-08-28T23:34:42.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40122024-08-28T23:34:42.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132024-08-28T23:34:42.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40142024-08-28T23:34:42.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40152024-08-28T23:34:42.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-08-28T23:34:42.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
40172024-08-28T23:34:42.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40182024-08-28T23:34:42.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40192024-08-28T23:34:42.133ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
40202024-08-28T23:34:42.133ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.275347ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
40212024-08-28T23:34:42.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d3a269-e04f-46c5-8f32-602cd28da2b0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40222024-08-28T23:34:42.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d3a269-e04f-46c5-8f32-602cd28da2b0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40232024-08-28T23:34:42.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 54d3a269-e04f-46c5-8f32-602cd28da2b0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40242024-08-28T23:34:42.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.27193ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40252024-08-28T23:34:42.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 21e2dc0f-1226-498b-9d55-4102c8ae685e response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
40262024-08-28T23:34:43.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55b606da-91c7-4996-af7c-1fb0abb1f285 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40272024-08-28T23:34:43.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55b606da-91c7-4996-af7c-1fb0abb1f285 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40282024-08-28T23:34:43.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 55b606da-91c7-4996-af7c-1fb0abb1f285 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40292024-08-28T23:34:44.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a9d436f7-78d3-4c79-b3fd-a4f8bc1badc6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40302024-08-28T23:34:44.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a9d436f7-78d3-4c79-b3fd-a4f8bc1badc6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40312024-08-28T23:34:44.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a9d436f7-78d3-4c79-b3fd-a4f8bc1badc6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40322024-08-28T23:34:45.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8f671db-281a-4aa8-b764-86a25a7b8003 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40332024-08-28T23:34:45.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8f671db-281a-4aa8-b764-86a25a7b8003 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40342024-08-28T23:34:45.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8f671db-281a-4aa8-b764-86a25a7b8003 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40352024-08-28T23:34:46.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8ba06b23-0d5a-428e-bb00-4868022fcc5e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40362024-08-28T23:34:46.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8ba06b23-0d5a-428e-bb00-4868022fcc5e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40372024-08-28T23:34:46.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8ba06b23-0d5a-428e-bb00-4868022fcc5e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40382024-08-28T23:34:47.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 88fa25b3-93fc-4e73-9061-62cc5020345d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40392024-08-28T23:34:47.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 88fa25b3-93fc-4e73-9061-62cc5020345d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40402024-08-28T23:34:47.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 88fa25b3-93fc-4e73-9061-62cc5020345d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40412024-08-28T23:34:48.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fc556c0-f380-4891-a5ac-37a9d0f286b3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40422024-08-28T23:34:48.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fc556c0-f380-4891-a5ac-37a9d0f286b3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40432024-08-28T23:34:48.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8fc556c0-f380-4891-a5ac-37a9d0f286b3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40442024-08-28T23:34:49.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4096db3e-a21f-49de-b3dc-8cfe90c48cfa roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40452024-08-28T23:34:49.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4096db3e-a21f-49de-b3dc-8cfe90c48cfa resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40462024-08-28T23:34:49.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4096db3e-a21f-49de-b3dc-8cfe90c48cfa response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40472024-08-28T23:34:50.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e75908b7-688e-4a0b-b2e3-65cf231d96d8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40482024-08-28T23:34:50.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e75908b7-688e-4a0b-b2e3-65cf231d96d8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40492024-08-28T23:34:50.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e75908b7-688e-4a0b-b2e3-65cf231d96d8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40502024-08-28T23:34:51.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96ea7f18-b979-4ff9-8414-101f5581acf8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40512024-08-28T23:34:51.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96ea7f18-b979-4ff9-8414-101f5581acf8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40522024-08-28T23:34:51.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96ea7f18-b979-4ff9-8414-101f5581acf8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
40532024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
40542024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
40552024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40562024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
40572024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
40582024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
40592024-08-28T23:34:52.089ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
40602024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.32\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
40612024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
40622024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
40632024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
40642024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
40652024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40662024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
40672024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40682024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40692024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40702024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
40712024-08-28T23:34:52.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
40722024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
40732024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40742024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40752024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40762024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40772024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40782024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40792024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40802024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40812024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40822024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40832024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40842024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
40852024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
40862024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
40872024-08-28T23:34:52.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
40882024-08-28T23:34:52.090ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40892024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40902024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
40912024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
40922024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40932024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
40942024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40952024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40962024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40972024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40982024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
40992024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41002024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
41012024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41022024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
41032024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41042024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
41052024-08-28T23:34:52.090ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
41062024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41072024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
41082024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41092024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41102024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
41112024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41122024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
41132024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41142024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
41152024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41162024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
41172024-08-28T23:34:52.090ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:24:52.090671975 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41182024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41192024-08-28T23:34:52.090ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 872236660 } })
41202024-08-28T23:34:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41212024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41222024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41232024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41242024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41252024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41262024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41272024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41282024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41292024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41302024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41312024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41322024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41332024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41342024-08-28T23:34:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41352024-08-28T23:34:52.092ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 873452072 } })
41362024-08-28T23:34:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
41372024-08-28T23:34:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.019404ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
41382024-08-28T23:34:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41392024-08-28T23:34:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.092315ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41402024-08-28T23:34:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.443111ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41412024-08-28T23:34:52.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41422024-08-28T23:34:52.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41432024-08-28T23:34:52.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41442024-08-28T23:34:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41452024-08-28T23:34:52.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 881434237 } })
41462024-08-28T23:34:52.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 881597700 } })
41472024-08-28T23:34:52.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41482024-08-28T23:34:52.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41492024-08-28T23:34:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41502024-08-28T23:34:52.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
41512024-08-28T23:34:52.101ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
41522024-08-28T23:34:52.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41532024-08-28T23:34:52.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41542024-08-28T23:34:52.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41552024-08-28T23:34:52.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41562024-08-28T23:34:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41572024-08-28T23:34:52.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41582024-08-28T23:34:52.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41592024-08-28T23:34:52.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41602024-08-28T23:34:52.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41612024-08-28T23:34:52.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41622024-08-28T23:34:52.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41632024-08-28T23:34:52.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.921312ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
41642024-08-28T23:34:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41652024-08-28T23:34:52.106ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41662024-08-28T23:34:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41672024-08-28T23:34:52.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41682024-08-28T23:34:52.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41692024-08-28T23:34:52.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41702024-08-28T23:34:52.110ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.748769ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
41712024-08-28T23:34:52.111ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:24:52.090671975 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41722024-08-28T23:34:52.111ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.579525ms iteration = 8 status = {"expiration":"2024-08-28T23:24:52.090671975Z","pruned":[]}
41732024-08-28T23:34:52.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742024-08-28T23:34:52.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41752024-08-28T23:34:52.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41762024-08-28T23:34:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41772024-08-28T23:34:52.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41782024-08-28T23:34:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41792024-08-28T23:34:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41802024-08-28T23:34:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41812024-08-28T23:34:52.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41822024-08-28T23:34:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41832024-08-28T23:34:52.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41842024-08-28T23:34:52.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41852024-08-28T23:34:52.122ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41862024-08-28T23:34:52.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41872024-08-28T23:34:52.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882024-08-28T23:34:52.126ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 908093333 } })
41892024-08-28T23:34:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41902024-08-28T23:34:52.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41912024-08-28T23:34:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41922024-08-28T23:34:52.127ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
41932024-08-28T23:34:52.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-08-28T23:34:52.151ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
41952024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41962024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41972024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41982024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41992024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42002024-08-28T23:34:52.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42012024-08-28T23:34:52.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42022024-08-28T23:34:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42032024-08-28T23:34:52.155ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42042024-08-28T23:34:52.155ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42052024-08-28T23:34:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42062024-08-28T23:34:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42072024-08-28T23:34:52.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.672805ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
42082024-08-28T23:34:52.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-08-28T23:34:52.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42102024-08-28T23:34:52.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42112024-08-28T23:34:52.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42122024-08-28T23:34:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42132024-08-28T23:34:52.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-08-28T23:34:52.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42152024-08-28T23:34:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42162024-08-28T23:34:52.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42172024-08-28T23:34:52.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42182024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
42192024-08-28T23:34:52.164ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
42202024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.477179ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
42212024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42222024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42232024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42242024-08-28T23:34:52.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42252024-08-28T23:34:52.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-08-28T23:34:52.168ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42272024-08-28T23:34:52.168ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42282024-08-28T23:34:52.168ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.091573ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42292024-08-28T23:34:52.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42302024-08-28T23:34:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42312024-08-28T23:34:52.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42322024-08-28T23:34:52.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42332024-08-28T23:34:52.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
42342024-08-28T23:34:52.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42352024-08-28T23:34:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42362024-08-28T23:34:52.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42372024-08-28T23:34:52.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42382024-08-28T23:34:52.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42392024-08-28T23:34:52.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42402024-08-28T23:34:52.175ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 85.746132ms iteration = 17 status = {"physical_disks_added":0}
42412024-08-28T23:34:52.183ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
42422024-08-28T23:34:52.183ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.586045ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
42432024-08-28T23:34:52.192ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
42442024-08-28T23:34:52.192ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42452024-08-28T23:34:52.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.275324ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
42462024-08-28T23:34:52.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42472024-08-28T23:34:52.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42482024-08-28T23:34:52.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42492024-08-28T23:34:52.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42502024-08-28T23:34:52.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42512024-08-28T23:34:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42522024-08-28T23:34:52.205ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42532024-08-28T23:34:52.205ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42542024-08-28T23:34:52.205ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42552024-08-28T23:34:52.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42562024-08-28T23:34:52.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42572024-08-28T23:34:52.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582024-08-28T23:34:52.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.980771ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42592024-08-28T23:34:52.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42602024-08-28T23:34:52.208ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42612024-08-28T23:34:52.208ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42622024-08-28T23:34:52.208ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42632024-08-28T23:34:52.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42642024-08-28T23:34:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42652024-08-28T23:34:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
42662024-08-28T23:34:52.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42672024-08-28T23:34:52.210ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.746482ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42682024-08-28T23:34:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42692024-08-28T23:34:52.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42702024-08-28T23:34:52.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42712024-08-28T23:34:52.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42722024-08-28T23:34:52.216ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.463796ms iteration = 15 status = 0
42732024-08-28T23:34:52.217ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
42742024-08-28T23:34:52.217ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 126.921013ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42752024-08-28T23:34:52.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42762024-08-28T23:34:52.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42772024-08-28T23:34:52.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42782024-08-28T23:34:52.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42792024-08-28T23:34:52.230ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42802024-08-28T23:34:52.230ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
42812024-08-28T23:34:52.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42822024-08-28T23:34:52.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42832024-08-28T23:34:52.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-08-28T23:34:52.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42852024-08-28T23:34:52.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42862024-08-28T23:34:52.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42872024-08-28T23:34:52.244ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
42882024-08-28T23:34:52.244ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42892024-08-28T23:34:52.244ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
42902024-08-28T23:34:52.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 154.303632ms iteration = 8 status = {"generation":2}
42912024-08-28T23:34:52.245ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42922024-08-28T23:34:52.245ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42932024-08-28T23:34:52.248ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb7872f-48e1-4eac-a68f-5297db6e0e7b", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
42942024-08-28T23:34:52.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42952024-08-28T23:34:52.250ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42962024-08-28T23:34:52.254ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42972024-08-28T23:34:52.254ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42982024-08-28T23:34:52.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42992024-08-28T23:34:52.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43002024-08-28T23:34:52.255ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
43012024-08-28T23:34:52.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.761021ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43022024-08-28T23:34:52.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43032024-08-28T23:34:52.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43042024-08-28T23:34:52.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43052024-08-28T23:34:52.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43062024-08-28T23:34:52.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43072024-08-28T23:34:52.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43082024-08-28T23:34:52.267ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43092024-08-28T23:34:52.302ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
43102024-08-28T23:34:52.302ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43112024-08-28T23:34:52.302ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ce006bf6-21e1-4ddb-a82d-1e20c0a92111", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43122024-08-28T23:34:52.302ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43132024-08-28T23:34:52.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
43142024-08-28T23:34:52.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62a3ce91-21d9-480a-9368-48d97a088ac9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
43152024-08-28T23:34:52.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62a3ce91-21d9-480a-9368-48d97a088ac9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
43162024-08-28T23:34:52.383ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43172024-08-28T23:34:52.427ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.040099ms iteration = 15 status = {}
43182024-08-28T23:34:52.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
43192024-08-28T23:34:52.435ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43202024-08-28T23:34:52.436ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba9203e1-b5c5-4d78-acb6-b40a2f915b12", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43212024-08-28T23:34:52.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43222024-08-28T23:34:52.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43232024-08-28T23:34:52.460ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/816d9007-e774-4191-bc87-aae13e0fd977/state
43242024-08-28T23:34:52.462ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/816d9007-e774-4191-bc87-aae13e0fd977/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f033bd6-564c-4b1b-88c4-7e9c513abf6f", "content-length": "130", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43252024-08-28T23:34:52.462ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d state = Running
43262024-08-28T23:34:52.462ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-28T23:34:36.974794094Z }
43272024-08-28T23:34:52.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d roles = RoleSet { roles: {} }
43282024-08-28T23:34:52.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d resource = Database result = Ok(())
43292024-08-28T23:34:52.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62a3ce91-21d9-480a-9368-48d97a088ac9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
43302024-08-28T23:34:52.463ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
43312024-08-28T23:34:52.463ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43322024-08-28T23:34:52.463ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
43332024-08-28T23:34:52.463ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 373.80501ms iteration = 8 status = {"generation":1}
43342024-08-28T23:34:52.464ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43352024-08-28T23:34:52.471ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43362024-08-28T23:34:52.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43372024-08-28T23:34:52.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43382024-08-28T23:34:52.472ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "08bd41c5-3f30-4b0d-937c-76eafe3e12e0", "content-length": "585", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43392024-08-28T23:34:52.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43402024-08-28T23:34:52.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43412024-08-28T23:34:52.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-08-28T23:34:52.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43432024-08-28T23:34:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43442024-08-28T23:34:52.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43452024-08-28T23:34:52.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43462024-08-28T23:34:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43472024-08-28T23:34:52.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43482024-08-28T23:34:52.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43492024-08-28T23:34:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43502024-08-28T23:34:52.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43512024-08-28T23:34:52.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43522024-08-28T23:34:52.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43532024-08-28T23:34:52.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43542024-08-28T23:34:52.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43552024-08-28T23:34:52.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43562024-08-28T23:34:52.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43572024-08-28T23:34:52.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43582024-08-28T23:34:52.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43592024-08-28T23:34:52.488ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43602024-08-28T23:34:52.488ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "781825a7-a1d7-4535-9358-46236d71983f", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43612024-08-28T23:34:52.490ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 399.751383ms iteration = 15 status = {}
43622024-08-28T23:34:52.495ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
43632024-08-28T23:34:52.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 405.352115ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
43642024-08-28T23:34:52.569ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43652024-08-28T23:34:52.569ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d2832c8e-0ffd-46aa-98af-2b7dae5bb547", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43662024-08-28T23:34:52.569ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43672024-08-28T23:34:52.571ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6abe3671-39a4-40ce-9b71-4ef6b44fea44", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43682024-08-28T23:34:52.571ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43692024-08-28T23:34:52.573ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43702024-08-28T23:34:52.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 483.494889ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43712024-08-28T23:34:52.616ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43722024-08-28T23:34:52.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8f48cd03-5757-4d35-9739-fb639f529bc0", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43732024-08-28T23:34:52.616ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43742024-08-28T23:34:52.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b165a629-f557-47f6-aca5-a4329a4f6a97", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43752024-08-28T23:34:52.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43762024-08-28T23:34:52.619ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9cde3847-30dd-4127-b518-8a52fd05b7b9", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43772024-08-28T23:34:52.619ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43782024-08-28T23:34:52.621ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
43792024-08-28T23:34:52.621ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 532.108684ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43802024-08-28T23:34:52.623ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43812024-08-28T23:34:52.623ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ed5ee5f-cb7a-439b-98f5-39ed2ad257f8", "content-length": "811", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43822024-08-28T23:34:52.623ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 242, 32, 148])), vni: Vni(11844078) }} sled = sock
43832024-08-28T23:34:52.623ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43842024-08-28T23:34:52.623ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43852024-08-28T23:34:52.625ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.757642ms iteration = 15 status = {}
43862024-08-28T23:34:52.660ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43872024-08-28T23:34:52.660ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a99c3eca-b6eb-47c3-afc5-8c3cf8d213bf", "content-length": "1", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43882024-08-28T23:34:52.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43892024-08-28T23:34:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43902024-08-28T23:34:52.670ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 580.410395ms iteration = 15 status = null
43912024-08-28T23:34:52.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43922024-08-28T23:34:52.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43932024-08-28T23:34:52.719ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
43942024-08-28T23:34:52.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43952024-08-28T23:34:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43962024-08-28T23:34:52.729ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43972024-08-28T23:34:52.729ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83546178-8103-412e-b761-af98c8360458", "content-length": "121", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
43982024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
43992024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
44002024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44012024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44022024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
44032024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
44042024-08-28T23:34:52.729ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
44052024-08-28T23:34:52.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44062024-08-28T23:34:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44072024-08-28T23:34:52.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44082024-08-28T23:34:52.733ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2fcd5c38-ad25-41f8-b21f-a69d9ce2febe", "content-length": "2", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
44092024-08-28T23:34:52.733ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44102024-08-28T23:34:52.733ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f9ba641-f4f3-41b5-8b13-997fc5449683", "content-length": "52", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
44112024-08-28T23:34:52.733ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
44122024-08-28T23:34:52.733ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44132024-08-28T23:34:52.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "200fc224-cba3-4119-8ce1-e489c617ff3d", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
44142024-08-28T23:34:52.830ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
44152024-08-28T23:34:52.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44162024-08-28T23:34:52.833ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90865ced-3d83-4acd-b343-ee93cf0022e0", "content-length": "667", "date": "Wed, 28 Aug 2024 23:34:52 GMT"} })
44172024-08-28T23:34:52.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44182024-08-28T23:34:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44192024-08-28T23:34:52.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44202024-08-28T23:34:52.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44212024-08-28T23:34:52.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44222024-08-28T23:34:52.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44232024-08-28T23:34:52.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44242024-08-28T23:34:52.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44252024-08-28T23:34:52.849ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 758.697353ms iteration = 15 status = {}
44262024-08-28T23:34:52.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 943 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 952e9bfb-aca4-4654-9180-6925ebcb7743 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
44272024-08-28T23:34:53.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0c44b5a5-67c8-44ab-9066-f69355675706 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44282024-08-28T23:34:53.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0c44b5a5-67c8-44ab-9066-f69355675706 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44292024-08-28T23:34:53.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0c44b5a5-67c8-44ab-9066-f69355675706 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44302024-08-28T23:34:54.097ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8996edda-43d8-4dff-856e-5d240baa396a uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-28T23:34:54.097201350Z }
44312024-08-28T23:34:54.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8996edda-43d8-4dff-856e-5d240baa396a roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44322024-08-28T23:34:54.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8996edda-43d8-4dff-856e-5d240baa396a resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44332024-08-28T23:34:54.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 12665 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8996edda-43d8-4dff-856e-5d240baa396a response_code = 204 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44342024-08-28T23:34:54.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d0909442-699d-44c9-a462-d492144fc94b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44352024-08-28T23:34:54.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d0909442-699d-44c9-a462-d492144fc94b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44362024-08-28T23:34:54.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d0909442-699d-44c9-a462-d492144fc94b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44372024-08-28T23:34:55.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 960af213-53ea-4146-b284-4fd92ce71dd7 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44382024-08-28T23:34:55.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 960af213-53ea-4146-b284-4fd92ce71dd7 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44392024-08-28T23:34:55.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 960af213-53ea-4146-b284-4fd92ce71dd7 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
44402024-08-28T23:34:56.464ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T23:34:56.464576299Z }
44412024-08-28T23:34:56.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44422024-08-28T23:34:56.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44432024-08-28T23:34:56.501ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_needs_update = true
44442024-08-28T23:34:56.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44452024-08-28T23:34:56.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44462024-08-28T23:34:56.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44472024-08-28T23:34:56.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44482024-08-28T23:34:56.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44492024-08-28T23:34:56.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44502024-08-28T23:34:56.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44512024-08-28T23:34:56.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44522024-08-28T23:34:56.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44532024-08-28T23:34:56.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44542024-08-28T23:34:56.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44552024-08-28T23:34:56.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44562024-08-28T23:34:56.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44572024-08-28T23:34:56.543ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, lookup_type: ById(7324ef70-30e4-4a3e-b6ee-698ed5a7bd63) }, key: 2e1a5565-fd15-4d5f-ab35-3d06bbba1d06, lookup_type: ById(2e1a5565-fd15-4d5f-ab35-3d06bbba1d06) }, key: c0c389c4-f3cf-41ea-9305-c3f3c87c996d, lookup_type: ById(c0c389c4-f3cf-41ea-9305-c3f3c87c996d) } result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44582024-08-28T23:34:56.555ZINFOnexus (dropshot_internal): starting update saga for c0c389c4-f3cf-41ea-9305-c3f3c87c996d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T23:34:56.464576299Z }
44592024-08-28T23:34:56.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90929 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bb40218-d674-4b6e-a0ff-a53063eacbd5 response_code = 204 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44602024-08-28T23:34:56.555ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update
44612024-08-28T23:34:56.556ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d78c2983-5535-4870-95e7-f7950b01db7b uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T23:34:56.464576299Z }
44622024-08-28T23:34:56.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d78c2983-5535-4870-95e7-f7950b01db7b roles = RoleSet { roles: {} } uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44632024-08-28T23:34:56.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d78c2983-5535-4870-95e7-f7950b01db7b resource = Database result = Ok(()) uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44642024-08-28T23:34:56.558ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"c0c389c4-f3cf-41ea-9305-c3f3c87c996d","lookup_type":{"ById":"c0c389c4-f3cf-41ea-9305-c3f3c87c996d"},"parent":{"key":"2e1a5565-fd15-4d5f-ab35-3d06bbba1d06","lookup_type":{"ById":"2e1a5565-fd15-4d5f-ab35-3d06bbba1d06"},"parent":{"key":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","lookup_type":{"ById":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44652024-08-28T23:34:56.558ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update
44662024-08-28T23:34:56.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4944 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d78c2983-5535-4870-95e7-f7950b01db7b response_code = 204 uri = /vmms/816d9007-e774-4191-bc87-aae13e0fd977
44672024-08-28T23:34:56.594ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update
44682024-08-28T23:34:56.594ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44692024-08-28T23:34:56.596ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44702024-08-28T23:34:56.596ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
44712024-08-28T23:34:56.601ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44722024-08-28T23:34:56.601ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
44732024-08-28T23:34:56.605ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44742024-08-28T23:34:56.605ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
44752024-08-28T23:34:56.610ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44762024-08-28T23:34:56.610ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f4d681c4-55c7-489c-bc0e-392b08ab765d")) node_id = 0 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
44772024-08-28T23:34:56.614ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
44782024-08-28T23:34:56.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
44792024-08-28T23:34:56.628ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update
44802024-08-28T23:34:56.628ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44812024-08-28T23:34:56.628ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44822024-08-28T23:34:56.630ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44832024-08-28T23:34:56.630ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44842024-08-28T23:34:56.632ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44852024-08-28T23:34:56.632ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44862024-08-28T23:34:56.634ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44872024-08-28T23:34:56.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44882024-08-28T23:34:56.635ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44892024-08-28T23:34:56.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44902024-08-28T23:34:56.637ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44912024-08-28T23:34:56.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44922024-08-28T23:34:56.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44932024-08-28T23:34:56.641ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, lookup_type: ById(7324ef70-30e4-4a3e-b6ee-698ed5a7bd63) }, key: 2e1a5565-fd15-4d5f-ab35-3d06bbba1d06, lookup_type: ById(2e1a5565-fd15-4d5f-ab35-3d06bbba1d06) }, key: c0c389c4-f3cf-41ea-9305-c3f3c87c996d, lookup_type: ById(c0c389c4-f3cf-41ea-9305-c3f3c87c996d) } result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44942024-08-28T23:34:56.641ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance updater_id = f4d681c4-55c7-489c-bc0e-392b08ab765d
44952024-08-28T23:34:56.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44962024-08-28T23:34:56.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44972024-08-28T23:34:56.657ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance updater_id = f4d681c4-55c7-489c-bc0e-392b08ab765d
44982024-08-28T23:34:56.657ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
44992024-08-28T23:34:56.657ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance
45002024-08-28T23:34:56.661ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d locked_gen = Generation(Generation(2)) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = LockInstance updater_id = f4d681c4-55c7-489c-bc0e-392b08ab765d
45012024-08-28T23:34:56.664ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45022024-08-28T23:34:56.664ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("f4d681c4-55c7-489c-bc0e-392b08ab765d")}) node_id = 1 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
45032024-08-28T23:34:56.667ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45042024-08-28T23:34:56.667ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
45052024-08-28T23:34:56.676ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45062024-08-28T23:34:56.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45072024-08-28T23:34:56.677ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45082024-08-28T23:34:56.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45092024-08-28T23:34:56.679ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45102024-08-28T23:34:56.679ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45112024-08-28T23:34:56.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45122024-08-28T23:34:56.683ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, lookup_type: ById(7324ef70-30e4-4a3e-b6ee-698ed5a7bd63) }, key: 2e1a5565-fd15-4d5f-ab35-3d06bbba1d06, lookup_type: ById(2e1a5565-fd15-4d5f-ab35-3d06bbba1d06) }, key: c0c389c4-f3cf-41ea-9305-c3f3c87c996d, lookup_type: ById(c0c389c4-f3cf-41ea-9305-c3f3c87c996d) } result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45132024-08-28T23:34:56.683ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45142024-08-28T23:34:56.683ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
45152024-08-28T23:34:56.691ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 816d9007-e774-4191-bc87-aae13e0fd977, time_created: 2024-08-28T23:34:28.518382Z, time_deleted: None, instance_id: c0c389c4-f3cf-41ea-9305-c3f3c87c996d, sled_id: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-28T23:34:56.464576Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-28T23:34:28.597860Z, gen: Generation(Generation(3)), propolis_id: Some(816d9007-e774-4191-bc87-aae13e0fd977), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(816d9007-e774-4191-bc87-aae13e0fd977 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-28T23:34:56.691229789Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
45162024-08-28T23:34:56.695ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45172024-08-28T23:34:56.698ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"c0c389c4-f3cf-41ea-9305-c3f3c87c996d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"816d9007-e774-4191-bc87-aae13e0fd977"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"c0c389c4-f3cf-41ea-9305-c3f3c87c996d","lookup_type":{"ById":"c0c389c4-f3cf-41ea-9305-c3f3c87c996d"},"parent":{"key":"2e1a5565-fd15-4d5f-ab35-3d06bbba1d06","lookup_type":{"ById":"2e1a5565-fd15-4d5f-ab35-3d06bbba1d06"},"parent":{"key":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","lookup_type":{"ById":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"f4d681c4-55c7-489c-bc0e-392b08ab765d"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"2e1a5565-fd15-4d5f-ab35-3d06bbba1d06","ram_diff":1073741824},"destroy_active_vmm":"816d9007-e774-4191-bc87-aae13e0fd977","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-28T23:34:56.691229789Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45182024-08-28T23:34:56.698ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45192024-08-28T23:34:56.702ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45202024-08-28T23:34:56.702ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45212024-08-28T23:34:56.702ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45222024-08-28T23:34:56.702ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45232024-08-28T23:34:56.706ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45242024-08-28T23:34:56.706ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45252024-08-28T23:34:56.710ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45262024-08-28T23:34:56.710ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45272024-08-28T23:34:56.713ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45282024-08-28T23:34:56.714ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b")) node_id = 0 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45292024-08-28T23:34:56.717ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45302024-08-28T23:34:56.717ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45312024-08-28T23:34:56.725ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d parent_lock = UpdaterLock { updater_id: f4d681c4-55c7-489c-bc0e-392b08ab765d, locked_gen: Generation(Generation(2)) } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45322024-08-28T23:34:56.725ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = BecomeUpdater
45332024-08-28T23:34:56.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = BecomeUpdater
45342024-08-28T23:34:56.734ZDEBGnexus (SagaExecutor): inherited lock from f4d681c4-55c7-489c-bc0e-392b08ab765d to 52f9d6f5-b449-4a95-b2e8-a69d24ceb68b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = f4d681c4-55c7-489c-bc0e-392b08ab765d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = BecomeUpdater updater_id = 52f9d6f5-b449-4a95-b2e8-a69d24ceb68b
45352024-08-28T23:34:56.734ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45362024-08-28T23:34:56.734ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45372024-08-28T23:34:56.734ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b")}) node_id = 1 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45382024-08-28T23:34:56.737ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45392024-08-28T23:34:56.737ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45402024-08-28T23:34:56.740ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45412024-08-28T23:34:56.740ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45422024-08-28T23:34:56.743ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45432024-08-28T23:34:56.743ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45442024-08-28T23:34:56.747ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45452024-08-28T23:34:56.749ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d
45462024-08-28T23:34:56.751ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45472024-08-28T23:34:56.752ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45482024-08-28T23:34:56.757ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45492024-08-28T23:34:56.757ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45502024-08-28T23:34:56.759ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
45512024-08-28T23:34:56.759ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45522024-08-28T23:34:56.759ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UpdateNetworkConfig
45532024-08-28T23:34:56.761ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
45542024-08-28T23:34:56.761ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
45552024-08-28T23:34:56.761ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
45562024-08-28T23:34:56.762ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
45572024-08-28T23:34:56.763ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
45582024-08-28T23:34:56.763ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
45592024-08-28T23:34:56.763ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
45602024-08-28T23:34:56.770ZDEBGnexus: notifying dendrite of updates instance_id = Some(c0c389c4-f3cf-41ea-9305-c3f3c87c996d (instance)) switch = switch0
45612024-08-28T23:34:56.772ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 553506354 } })
45622024-08-28T23:34:56.772ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
45632024-08-28T23:34:56.802ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45642024-08-28T23:34:56.802ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45652024-08-28T23:34:56.803ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27f3a2e0-a781-4fe2-9f51-1f2fea84d471", "content-length": "26", "date": "Wed, 28 Aug 2024 23:34:56 GMT"} })
45662024-08-28T23:34:56.803ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45672024-08-28T23:34:56.803ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45682024-08-28T23:34:56.832ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
45692024-08-28T23:34:56.833ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d6a2f1a-89de-4049-8a29-cbed283fed7e", "content-length": "4", "date": "Wed, 28 Aug 2024 23:34:56 GMT"} })
45702024-08-28T23:34:56.834ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45712024-08-28T23:34:56.834ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45722024-08-28T23:34:56.837ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45732024-08-28T23:34:56.837ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45742024-08-28T23:34:56.843ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
45752024-08-28T23:34:56.843ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
45762024-08-28T23:34:56.857ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-28T23:34:56.848440Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2e1a5565-fd15-4d5f-ab35-3d06bbba1d06, time_modified: Some(2024-08-28T23:34:56.848440Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, time_modified: Some(2024-08-28T23:34:56.848440Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45772024-08-28T23:34:56.857ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45782024-08-28T23:34:56.857ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45792024-08-28T23:34:56.860ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45802024-08-28T23:34:56.860ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45812024-08-28T23:34:56.865ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45822024-08-28T23:34:56.865ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UnassignOximeterProducer
45832024-08-28T23:34:56.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UnassignOximeterProducer
45842024-08-28T23:34:56.870ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 099a839b-4790-447a-827a-80c4d38e82a0 producer_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45852024-08-28T23:34:56.870ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UnassignOximeterProducer
45862024-08-28T23:34:56.870ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = UnassignOximeterProducer
45872024-08-28T23:34:56.904ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45882024-08-28T23:34:56.904ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/c0c389c4-f3cf-41ea-9305-c3f3c87c996d
45892024-08-28T23:34:56.905ZDEBGnexus (SagaExecutor): client response oximeter-collector = c0c389c4-f3cf-41ea-9305-c3f3c87c996d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/c0c389c4-f3cf-41ea-9305-c3f3c87c996d", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8422904a-5d2e-4b6d-bb68-8e4a64b80bc5", "date": "Wed, 28 Aug 2024 23:34:56 GMT"} }) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45902024-08-28T23:34:56.905ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 099a839b-4790-447a-827a-80c4d38e82a0 producer_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45912024-08-28T23:34:56.905ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45922024-08-28T23:34:56.905ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45932024-08-28T23:34:56.908ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
45942024-08-28T23:34:56.908ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
45952024-08-28T23:34:56.911ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d lock = UpdaterLock { updater_id: 52f9d6f5-b449-4a95-b2e8-a69d24ceb68b, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-28T23:34:56.691229789Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45962024-08-28T23:34:56.911ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
45972024-08-28T23:34:56.912ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
45982024-08-28T23:34:56.945ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d new_runtime = InstanceRuntimeState { time_updated: 2024-08-28T23:34:56.691229789Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
45992024-08-28T23:34:56.945ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46002024-08-28T23:34:56.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
46012024-08-28T23:34:56.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46022024-08-28T23:34:56.945ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46032024-08-28T23:34:56.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
46042024-08-28T23:34:56.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46052024-08-28T23:34:56.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46062024-08-28T23:34:56.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46072024-08-28T23:34:56.947ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46082024-08-28T23:34:56.947ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46092024-08-28T23:34:56.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46102024-08-28T23:34:56.948ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46112024-08-28T23:34:56.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46122024-08-28T23:34:56.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46132024-08-28T23:34:56.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46142024-08-28T23:34:56.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46152024-08-28T23:34:56.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46162024-08-28T23:34:56.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46172024-08-28T23:34:56.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46182024-08-28T23:34:56.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46192024-08-28T23:34:56.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46202024-08-28T23:34:56.953ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, lookup_type: ById(7324ef70-30e4-4a3e-b6ee-698ed5a7bd63) }, key: 2e1a5565-fd15-4d5f-ab35-3d06bbba1d06, lookup_type: ById(2e1a5565-fd15-4d5f-ab35-3d06bbba1d06) }, key: c0c389c4-f3cf-41ea-9305-c3f3c87c996d, lookup_type: ById(c0c389c4-f3cf-41ea-9305-c3f3c87c996d) } result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46212024-08-28T23:34:56.953ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46222024-08-28T23:34:56.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = CommitInstanceUpdates
46232024-08-28T23:34:56.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46242024-08-28T23:34:56.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46252024-08-28T23:34:56.958ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46262024-08-28T23:34:56.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46272024-08-28T23:34:56.961ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46282024-08-28T23:34:56.961ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46292024-08-28T23:34:56.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46302024-08-28T23:34:56.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46312024-08-28T23:34:56.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46322024-08-28T23:34:56.965ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46332024-08-28T23:34:56.965ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("c0c389c4-f3cf-41ea-9305-c3f3c87c996d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("816d9007-e774-4191-bc87-aae13e0fd977")}) node_id = 7 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46342024-08-28T23:34:56.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46352024-08-28T23:34:56.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46362024-08-28T23:34:56.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46372024-08-28T23:34:56.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46382024-08-28T23:34:56.968ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46392024-08-28T23:34:56.968ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46402024-08-28T23:34:56.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46412024-08-28T23:34:56.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46422024-08-28T23:34:56.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46432024-08-28T23:34:56.972ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46442024-08-28T23:34:56.972ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46452024-08-28T23:34:56.976ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46462024-08-28T23:34:56.976ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46472024-08-28T23:34:56.980ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
46482024-08-28T23:34:56.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = ReleaseSledResources
46492024-08-28T23:34:56.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = ReleaseSledResources
46502024-08-28T23:34:56.989ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46512024-08-28T23:34:56.989ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46522024-08-28T23:34:56.993ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46532024-08-28T23:34:56.993ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46542024-08-28T23:34:57.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46552024-08-28T23:34:57.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7b2959ca-7594-4c67-8b80-4423c5aa8099", "content-length": "691", "date": "Wed, 28 Aug 2024 23:34:57 GMT"} })
46562024-08-28T23:34:57.004ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46572024-08-28T23:34:57.004ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46582024-08-28T23:34:57.004ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46592024-08-28T23:34:57.005ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 60.292708ms iteration = 16 status = {}
46602024-08-28T23:34:57.007ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d propolis_id = 816d9007-e774-4191-bc87-aae13e0fd977 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update
46612024-08-28T23:34:57.007ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = MarkVmmDeleted
46622024-08-28T23:34:57.007ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_node = MarkVmmDeleted
46632024-08-28T23:34:57.015ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46642024-08-28T23:34:57.015ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46652024-08-28T23:34:57.018ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46662024-08-28T23:34:57.018ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46672024-08-28T23:34:57.021ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46682024-08-28T23:34:57.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46692024-08-28T23:34:57.024ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46702024-08-28T23:34:57.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46712024-08-28T23:34:57.027ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46722024-08-28T23:34:57.027ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46732024-08-28T23:34:57.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46742024-08-28T23:34:57.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1613ed8b-4493-41aa-882e-b6e08a0141a5", "content-length": "372", "date": "Wed, 28 Aug 2024 23:34:57 GMT"} })
46752024-08-28T23:34:57.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46762024-08-28T23:34:57.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46772024-08-28T23:34:57.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46782024-08-28T23:34:57.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46792024-08-28T23:34:57.045ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7754b917-c4cf-4895-b364-535273a3d116 sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46802024-08-28T23:34:57.045ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7754b917-c4cf-4895-b364-535273a3d116
46812024-08-28T23:34:57.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46822024-08-28T23:34:57.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46832024-08-28T23:34:57.050ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46842024-08-28T23:34:57.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4166cda3-8457-4e75-a27f-e510d8646e08", "date": "Wed, 28 Aug 2024 23:34:57 GMT"} })
46852024-08-28T23:34:57.052ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 106.577351ms iteration = 16 status = {}
46862024-08-28T23:34:57.078ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46872024-08-28T23:34:57.078ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 7754b917-c4cf-4895-b364-535273a3d116 saga_name = instance-update saga_result = SagaResult { saga_id: 7754b917-c4cf-4895-b364-535273a3d116, saga_log: SagaLog { saga_id: 7754b917-c4cf-4895-b364-535273a3d116, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("c0c389c4-f3cf-41ea-9305-c3f3c87c996d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("816d9007-e774-4191-bc87-aae13e0fd977")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("c0c389c4-f3cf-41ea-9305-c3f3c87c996d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("816d9007-e774-4191-bc87-aae13e0fd977")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("52f9d6f5-b449-4a95-b2e8-a69d24ceb68b")}} }) }
46882024-08-28T23:34:57.078ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 7754b917-c4cf-4895-b364-535273a3d116 instance_id = c0c389c4-f3cf-41ea-9305-c3f3c87c996d saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update
46892024-08-28T23:34:57.078ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46902024-08-28T23:34:57.078ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
46912024-08-28T23:34:57.081ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46922024-08-28T23:34:57.081ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
46932024-08-28T23:34:57.085ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46942024-08-28T23:34:57.085ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
46952024-08-28T23:34:57.092ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46962024-08-28T23:34:57.092ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b
46972024-08-28T23:34:57.129ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update sec_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
46982024-08-28T23:34:57.129ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = d613c147-86b5-41f5-8ca6-5a4a17f71b5b saga_name = start-instance-update saga_result = SagaResult { saga_id: d613c147-86b5-41f5-8ca6-5a4a17f71b5b, saga_log: SagaLog { saga_id: d613c147-86b5-41f5-8ca6-5a4a17f71b5b, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("f4d681c4-55c7-489c-bc0e-392b08ab765d")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("f4d681c4-55c7-489c-bc0e-392b08ab765d")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("f4d681c4-55c7-489c-bc0e-392b08ab765d"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("f4d681c4-55c7-489c-bc0e-392b08ab765d")}} }) }
46992024-08-28T23:34:57.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e21a891-bb39-46d1-9b3d-8dc6b481aa20 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47002024-08-28T23:34:57.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e21a891-bb39-46d1-9b3d-8dc6b481aa20 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47012024-08-28T23:34:57.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6e21a891-bb39-46d1-9b3d-8dc6b481aa20 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47022024-08-28T23:34:58.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82b0d817-aa2e-4d8b-a776-9181a064f14e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47032024-08-28T23:34:58.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82b0d817-aa2e-4d8b-a776-9181a064f14e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47042024-08-28T23:34:58.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82b0d817-aa2e-4d8b-a776-9181a064f14e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47052024-08-28T23:34:59.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cddfa584-1723-4868-8562-d78d5b4ccd3d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47062024-08-28T23:34:59.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cddfa584-1723-4868-8562-d78d5b4ccd3d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47072024-08-28T23:34:59.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cddfa584-1723-4868-8562-d78d5b4ccd3d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47082024-08-28T23:35:00.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bd44d08-b252-44da-b71e-59c450a86553 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47092024-08-28T23:35:00.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bd44d08-b252-44da-b71e-59c450a86553 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47102024-08-28T23:35:00.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4bd44d08-b252-44da-b71e-59c450a86553 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47112024-08-28T23:35:01.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 594429fb-5704-47aa-be43-0948a39c7bbf roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47122024-08-28T23:35:01.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 594429fb-5704-47aa-be43-0948a39c7bbf resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47132024-08-28T23:35:01.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 594429fb-5704-47aa-be43-0948a39c7bbf response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47142024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
47152024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
47162024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47172024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47182024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192024-08-28T23:35:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47202024-08-28T23:35:02.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212024-08-28T23:35:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47222024-08-28T23:35:02.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47232024-08-28T23:35:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47242024-08-28T23:35:02.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47252024-08-28T23:35:02.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47262024-08-28T23:35:02.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47272024-08-28T23:35:02.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47282024-08-28T23:35:02.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-08-28T23:35:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
47302024-08-28T23:35:02.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47312024-08-28T23:35:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47322024-08-28T23:35:02.133ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
47332024-08-28T23:35:02.133ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.473732ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
47342024-08-28T23:35:02.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.866891ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47352024-08-28T23:35:02.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 698059ed-4714-4675-ade8-a3e852b7f6c7 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47362024-08-28T23:35:02.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 698059ed-4714-4675-ade8-a3e852b7f6c7 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47372024-08-28T23:35:02.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 698059ed-4714-4675-ade8-a3e852b7f6c7 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47382024-08-28T23:35:02.929ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 997 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 88aa590e-639b-4d7f-b2bd-6762f9c667ec response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
47392024-08-28T23:35:03.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eb743b-50ee-4c79-9205-663dedc4c4a1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47402024-08-28T23:35:03.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eb743b-50ee-4c79-9205-663dedc4c4a1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47412024-08-28T23:35:03.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 84eb743b-50ee-4c79-9205-663dedc4c4a1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47422024-08-28T23:35:04.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7966fd85-0958-41fb-8f0f-21225af8f47c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47432024-08-28T23:35:04.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7966fd85-0958-41fb-8f0f-21225af8f47c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47442024-08-28T23:35:04.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7966fd85-0958-41fb-8f0f-21225af8f47c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47452024-08-28T23:35:05.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28819de4-35db-43d4-afce-f13bf7aecda6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47462024-08-28T23:35:05.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28819de4-35db-43d4-afce-f13bf7aecda6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47472024-08-28T23:35:05.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 28819de4-35db-43d4-afce-f13bf7aecda6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47482024-08-28T23:35:06.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9061315b-9a0c-454e-bc65-8ef4fd2da723 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47492024-08-28T23:35:06.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9061315b-9a0c-454e-bc65-8ef4fd2da723 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47502024-08-28T23:35:06.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9061315b-9a0c-454e-bc65-8ef4fd2da723 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47512024-08-28T23:35:07.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11cfe03a-8d1b-4603-8f34-9ff1e0bf3800 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47522024-08-28T23:35:07.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11cfe03a-8d1b-4603-8f34-9ff1e0bf3800 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47532024-08-28T23:35:07.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 11cfe03a-8d1b-4603-8f34-9ff1e0bf3800 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47542024-08-28T23:35:08.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 58bbace3-fcd7-48d6-aba2-225ec926c73b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47552024-08-28T23:35:08.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 58bbace3-fcd7-48d6-aba2-225ec926c73b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47562024-08-28T23:35:08.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 58bbace3-fcd7-48d6-aba2-225ec926c73b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47572024-08-28T23:35:09.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb9d1643-d019-4c65-bb3c-913afbe9e12f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47582024-08-28T23:35:09.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb9d1643-d019-4c65-bb3c-913afbe9e12f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47592024-08-28T23:35:09.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bb9d1643-d019-4c65-bb3c-913afbe9e12f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47602024-08-28T23:35:10.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dede51e8-29a5-48ad-9bc1-91fb08d64ca2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47612024-08-28T23:35:10.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dede51e8-29a5-48ad-9bc1-91fb08d64ca2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47622024-08-28T23:35:10.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dede51e8-29a5-48ad-9bc1-91fb08d64ca2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47632024-08-28T23:35:11.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f4ef695-a4c8-42a5-9e8a-3ad697596e18 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47642024-08-28T23:35:11.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f4ef695-a4c8-42a5-9e8a-3ad697596e18 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47652024-08-28T23:35:11.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2f4ef695-a4c8-42a5-9e8a-3ad697596e18 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47662024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
47672024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47682024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47692024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
47702024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47712024-08-28T23:35:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47722024-08-28T23:35:12.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-08-28T23:35:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47742024-08-28T23:35:12.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752024-08-28T23:35:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762024-08-28T23:35:12.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47772024-08-28T23:35:12.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47782024-08-28T23:35:12.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792024-08-28T23:35:12.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
47802024-08-28T23:35:12.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812024-08-28T23:35:12.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822024-08-28T23:35:12.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
47832024-08-28T23:35:12.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.747554ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
47842024-08-28T23:35:12.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47852024-08-28T23:35:12.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47862024-08-28T23:35:12.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.057321ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47872024-08-28T23:35:12.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c2bdf83-0d7c-445c-b38c-ebc1c6c75e21 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47882024-08-28T23:35:12.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c2bdf83-0d7c-445c-b38c-ebc1c6c75e21 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47892024-08-28T23:35:12.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9c2bdf83-0d7c-445c-b38c-ebc1c6c75e21 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47902024-08-28T23:35:12.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 868 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 38c5e2ec-1b93-4644-a5c3-83427e08871d response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
47912024-08-28T23:35:13.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 49e0704b-12ef-44d2-8d1a-86c515c530f6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47922024-08-28T23:35:13.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 49e0704b-12ef-44d2-8d1a-86c515c530f6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47932024-08-28T23:35:13.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 49e0704b-12ef-44d2-8d1a-86c515c530f6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47942024-08-28T23:35:14.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43e0b4c8-d137-400f-ad85-4ae98463a9f3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47952024-08-28T23:35:14.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43e0b4c8-d137-400f-ad85-4ae98463a9f3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47962024-08-28T23:35:14.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43e0b4c8-d137-400f-ad85-4ae98463a9f3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47972024-08-28T23:35:15.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ab51ff53-a3a8-4ff4-ab26-66828eb66430 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47982024-08-28T23:35:15.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ab51ff53-a3a8-4ff4-ab26-66828eb66430 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
47992024-08-28T23:35:15.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ab51ff53-a3a8-4ff4-ab26-66828eb66430 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48002024-08-28T23:35:17.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fce4fadb-f639-4fc6-9b1a-7fa2db5e3834 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48012024-08-28T23:35:17.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fce4fadb-f639-4fc6-9b1a-7fa2db5e3834 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48022024-08-28T23:35:17.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fce4fadb-f639-4fc6-9b1a-7fa2db5e3834 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48032024-08-28T23:35:18.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bfea8a85-20bc-43f1-9425-5aee556912f5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48042024-08-28T23:35:18.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bfea8a85-20bc-43f1-9425-5aee556912f5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48052024-08-28T23:35:18.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bfea8a85-20bc-43f1-9425-5aee556912f5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48062024-08-28T23:35:19.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f1a5766-d216-40cc-996d-6e8cef85b9ea roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48072024-08-28T23:35:19.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f1a5766-d216-40cc-996d-6e8cef85b9ea resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48082024-08-28T23:35:19.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8f1a5766-d216-40cc-996d-6e8cef85b9ea response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48092024-08-28T23:35:20.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34cfad21-1d84-4821-9765-7b244f69854f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48102024-08-28T23:35:20.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34cfad21-1d84-4821-9765-7b244f69854f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48112024-08-28T23:35:20.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 34cfad21-1d84-4821-9765-7b244f69854f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48122024-08-28T23:35:21.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b18e45b0-6bc8-4e4e-8545-cf9b527a60f1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48132024-08-28T23:35:21.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b18e45b0-6bc8-4e4e-8545-cf9b527a60f1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48142024-08-28T23:35:21.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b18e45b0-6bc8-4e4e-8545-cf9b527a60f1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48152024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
48162024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48172024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
48182024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
48192024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
48202024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48212024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
48222024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48232024-08-28T23:35:22.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48252024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48262024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48272024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48282024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
48292024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
48302024-08-28T23:35:22.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
48312024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48322024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48332024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
48342024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
48352024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48362024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
48382024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48392024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
48402024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48412024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48422024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
48432024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48442024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
48452024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48462024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
48472024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
48482024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48492024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48502024-08-28T23:35:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
48512024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48522024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48532024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48542024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48552024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48562024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48572024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48582024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48592024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48602024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48612024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48622024-08-28T23:35:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48632024-08-28T23:35:22.092ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 874214896 } })
48642024-08-28T23:35:22.093ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.335361ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48652024-08-28T23:35:22.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48662024-08-28T23:35:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 875332326 } })
48672024-08-28T23:35:22.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48682024-08-28T23:35:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
48692024-08-28T23:35:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
48702024-08-28T23:35:22.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48722024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48732024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48742024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48752024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48762024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48772024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48782024-08-28T23:35:22.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48792024-08-28T23:35:22.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48802024-08-28T23:35:22.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48812024-08-28T23:35:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48822024-08-28T23:35:22.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48832024-08-28T23:35:22.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48842024-08-28T23:35:22.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48852024-08-28T23:35:22.104ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 886328317 } })
48862024-08-28T23:35:22.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48872024-08-28T23:35:22.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48882024-08-28T23:35:22.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48892024-08-28T23:35:22.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48902024-08-28T23:35:22.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
48912024-08-28T23:35:22.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48922024-08-28T23:35:22.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0178435a-bee3-4091-beab-13ecc41b7975 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48932024-08-28T23:35:22.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0178435a-bee3-4091-beab-13ecc41b7975 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48942024-08-28T23:35:22.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0178435a-bee3-4091-beab-13ecc41b7975 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
48952024-08-28T23:35:22.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48962024-08-28T23:35:22.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48972024-08-28T23:35:22.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.442101ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
48982024-08-28T23:35:22.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48992024-08-28T23:35:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49002024-08-28T23:35:22.135ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49012024-08-28T23:35:22.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49022024-08-28T23:35:22.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49032024-08-28T23:35:22.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49042024-08-28T23:35:22.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49052024-08-28T23:35:22.138ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49062024-08-28T23:35:22.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49072024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49082024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49092024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49102024-08-28T23:35:22.139ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49112024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49122024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49132024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49142024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49152024-08-28T23:35:22.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49162024-08-28T23:35:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49172024-08-28T23:35:22.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
49182024-08-28T23:35:22.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49192024-08-28T23:35:22.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49202024-08-28T23:35:22.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49212024-08-28T23:35:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49222024-08-28T23:35:22.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49232024-08-28T23:35:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49242024-08-28T23:35:22.152ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
49252024-08-28T23:35:22.152ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.274804ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
49262024-08-28T23:35:22.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.325349ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49272024-08-28T23:35:22.168ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49282024-08-28T23:35:22.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49292024-08-28T23:35:22.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49302024-08-28T23:35:22.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49312024-08-28T23:35:22.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49322024-08-28T23:35:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49332024-08-28T23:35:22.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-08-28T23:35:22.176ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49352024-08-28T23:35:22.176ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.199062ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
49362024-08-28T23:35:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
49372024-08-28T23:35:22.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49382024-08-28T23:35:22.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49392024-08-28T23:35:22.178ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.092477ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
49402024-08-28T23:35:22.178ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49412024-08-28T23:35:22.178ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49422024-08-28T23:35:22.178ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.072055ms iteration = 16 status = 0
49432024-08-28T23:35:22.178ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.040064ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
49442024-08-28T23:35:22.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.709884ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49452024-08-28T23:35:22.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49462024-08-28T23:35:22.185ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49472024-08-28T23:35:22.185ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b1d07b-45d2-489e-aabb-62f3c5f7b3ac", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
49482024-08-28T23:35:22.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49492024-08-28T23:35:22.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49502024-08-28T23:35:22.190ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49512024-08-28T23:35:22.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49522024-08-28T23:35:22.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49532024-08-28T23:35:22.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49542024-08-28T23:35:22.199ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
49552024-08-28T23:35:22.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.390514ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49562024-08-28T23:35:22.201ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49572024-08-28T23:35:22.201ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49582024-08-28T23:35:22.201ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c473577-cacb-453c-acda-ce4d9fdb1167", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
49592024-08-28T23:35:22.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49602024-08-28T23:35:22.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49612024-08-28T23:35:22.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49622024-08-28T23:35:22.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49632024-08-28T23:35:22.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
49642024-08-28T23:35:22.309ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49652024-08-28T23:35:22.309ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae89ae28-2510-4e8f-bb58-9555b38a549a", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
49662024-08-28T23:35:22.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49672024-08-28T23:35:22.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
49682024-08-28T23:35:22.322ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49692024-08-28T23:35:22.322ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0593887-240a-4bcf-971b-db7b87c9263b", "content-length": "2", "date": "Wed, 28 Aug 2024 23:35:21 GMT"} })
49702024-08-28T23:35:22.324ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49712024-08-28T23:35:22.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49722024-08-28T23:35:22.329ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.114684ms iteration = 16 status = {}
49732024-08-28T23:35:22.334ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49742024-08-28T23:35:22.337ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 248.034308ms iteration = 16 status = null
49752024-08-28T23:35:22.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49762024-08-28T23:35:22.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49772024-08-28T23:35:22.373ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 283.606717ms iteration = 18 status = {"physical_disks_added":0}
49782024-08-28T23:35:22.388ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c36a1a59-0a60-4ef0-8445-ebf6aca90382", "content-length": "372", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
49792024-08-28T23:35:22.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49802024-08-28T23:35:22.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49812024-08-28T23:35:22.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49822024-08-28T23:35:22.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49832024-08-28T23:35:22.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842024-08-28T23:35:22.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49852024-08-28T23:35:22.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49862024-08-28T23:35:22.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49872024-08-28T23:35:22.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49882024-08-28T23:35:22.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49892024-08-28T23:35:22.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-08-28T23:35:22.400ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49912024-08-28T23:35:22.401ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ca77b26a-e518-4728-9eda-3516cd2c2993", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
49922024-08-28T23:35:22.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49932024-08-28T23:35:22.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49942024-08-28T23:35:22.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49952024-08-28T23:35:22.402ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 311.75752ms iteration = 17 status = {}
49962024-08-28T23:35:22.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49972024-08-28T23:35:22.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49982024-08-28T23:35:22.426ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
49992024-08-28T23:35:22.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50002024-08-28T23:35:22.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50012024-08-28T23:35:22.436ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50022024-08-28T23:35:22.437ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "61ae0e7a-6d49-4c58-b87f-e11ce6d7af61", "content-length": "121", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50032024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50042024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
50052024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50062024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50072024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
50082024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
50092024-08-28T23:35:22.437ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
50102024-08-28T23:35:22.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50112024-08-28T23:35:22.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50122024-08-28T23:35:22.441ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50132024-08-28T23:35:22.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6dbc185-531d-4271-a318-07bd766bbca2", "content-length": "691", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50142024-08-28T23:35:22.441ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50152024-08-28T23:35:22.441ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50162024-08-28T23:35:22.441ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50172024-08-28T23:35:22.442ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.527415ms iteration = 17 status = {}
50182024-08-28T23:35:22.443ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50192024-08-28T23:35:22.443ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a17f18cb-9420-4a6e-8041-6a5063e054d1", "content-length": "2", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50202024-08-28T23:35:22.443ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50212024-08-28T23:35:22.444ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed9ef894-9b47-4f29-953a-63fbd728cd0d", "content-length": "52", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50222024-08-28T23:35:22.444ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
50232024-08-28T23:35:22.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50242024-08-28T23:35:22.536ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7c79f51a-33ee-41e8-a9e9-7528d47cc2b6", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50252024-08-28T23:35:22.536ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
50262024-08-28T23:35:22.536ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50272024-08-28T23:35:22.537ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "912181b3-582e-4301-a21f-3930f09bcda9", "content-length": "667", "date": "Wed, 28 Aug 2024 23:35:22 GMT"} })
50282024-08-28T23:35:22.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50292024-08-28T23:35:22.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50302024-08-28T23:35:22.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50312024-08-28T23:35:22.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50322024-08-28T23:35:22.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50332024-08-28T23:35:22.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50342024-08-28T23:35:22.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50352024-08-28T23:35:22.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50362024-08-28T23:35:22.554ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 463.403072ms iteration = 16 status = {}
50372024-08-28T23:35:22.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 756e5095-b1eb-439f-bc05-2f760e72f013 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
50382024-08-28T23:35:23.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d2dde17d-c762-42a7-a6d1-e9ec80144b0e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50392024-08-28T23:35:23.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d2dde17d-c762-42a7-a6d1-e9ec80144b0e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50402024-08-28T23:35:23.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d2dde17d-c762-42a7-a6d1-e9ec80144b0e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50412024-08-28T23:35:24.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38f3d054-31c4-4e71-bfa2-bf8d5d94fb65 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50422024-08-28T23:35:24.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38f3d054-31c4-4e71-bfa2-bf8d5d94fb65 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50432024-08-28T23:35:24.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38f3d054-31c4-4e71-bfa2-bf8d5d94fb65 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50442024-08-28T23:35:25.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2f0e1b4-d228-4bdc-9892-60808c5d1cc8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50452024-08-28T23:35:25.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2f0e1b4-d228-4bdc-9892-60808c5d1cc8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50462024-08-28T23:35:25.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b2f0e1b4-d228-4bdc-9892-60808c5d1cc8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50472024-08-28T23:35:26.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae37c2d7-02b5-4a09-aa22-977b2b4910a5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50482024-08-28T23:35:26.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae37c2d7-02b5-4a09-aa22-977b2b4910a5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50492024-08-28T23:35:26.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ae37c2d7-02b5-4a09-aa22-977b2b4910a5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50502024-08-28T23:35:27.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2eacfb5a-d0a4-4146-bc5f-22335683098c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50512024-08-28T23:35:27.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2eacfb5a-d0a4-4146-bc5f-22335683098c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50522024-08-28T23:35:27.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2eacfb5a-d0a4-4146-bc5f-22335683098c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50532024-08-28T23:35:28.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d935fcda-8fa1-4a57-8544-18f65c015720 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50542024-08-28T23:35:28.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d935fcda-8fa1-4a57-8544-18f65c015720 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50552024-08-28T23:35:28.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d935fcda-8fa1-4a57-8544-18f65c015720 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50562024-08-28T23:35:29.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 737f02fa-7a1a-40dd-b834-d9fd1cdbe28c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50572024-08-28T23:35:29.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 737f02fa-7a1a-40dd-b834-d9fd1cdbe28c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50582024-08-28T23:35:29.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 737f02fa-7a1a-40dd-b834-d9fd1cdbe28c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50592024-08-28T23:35:30.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cb299cd7-c1f4-4a03-8637-ecc1f1ec048c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50602024-08-28T23:35:30.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cb299cd7-c1f4-4a03-8637-ecc1f1ec048c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50612024-08-28T23:35:30.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = cb299cd7-c1f4-4a03-8637-ecc1f1ec048c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50622024-08-28T23:35:31.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1691cbed-35f1-4174-b80b-e93b56e6bfd3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50632024-08-28T23:35:31.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1691cbed-35f1-4174-b80b-e93b56e6bfd3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50642024-08-28T23:35:31.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1691cbed-35f1-4174-b80b-e93b56e6bfd3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50652024-08-28T23:35:32.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
50662024-08-28T23:35:32.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50672024-08-28T23:35:32.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50682024-08-28T23:35:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
50692024-08-28T23:35:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50702024-08-28T23:35:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50712024-08-28T23:35:32.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50722024-08-28T23:35:32.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50732024-08-28T23:35:32.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50742024-08-28T23:35:32.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50752024-08-28T23:35:32.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50762024-08-28T23:35:32.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50772024-08-28T23:35:32.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50782024-08-28T23:35:32.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50792024-08-28T23:35:32.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.474756ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50802024-08-28T23:35:32.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50812024-08-28T23:35:32.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
50822024-08-28T23:35:32.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50832024-08-28T23:35:32.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50842024-08-28T23:35:32.162ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
50852024-08-28T23:35:32.162ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.865587ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
50862024-08-28T23:35:32.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 93406118-236f-4e77-b385-18a435e2601c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50872024-08-28T23:35:32.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 93406118-236f-4e77-b385-18a435e2601c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50882024-08-28T23:35:32.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 93406118-236f-4e77-b385-18a435e2601c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50892024-08-28T23:35:32.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1095 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 0f054b7b-dd04-44c7-91e5-fc1ca391c8e0 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
50902024-08-28T23:35:33.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ab89597-bd0c-437b-b6dc-4600a30a8a83 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50912024-08-28T23:35:33.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ab89597-bd0c-437b-b6dc-4600a30a8a83 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50922024-08-28T23:35:33.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ab89597-bd0c-437b-b6dc-4600a30a8a83 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50932024-08-28T23:35:34.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9a1a33a-02a3-4d95-ae94-1d5702eabe29 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50942024-08-28T23:35:34.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9a1a33a-02a3-4d95-ae94-1d5702eabe29 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50952024-08-28T23:35:34.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9a1a33a-02a3-4d95-ae94-1d5702eabe29 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50962024-08-28T23:35:35.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8430a7f3-977a-498d-8b69-83e66e83a75a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50972024-08-28T23:35:35.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8430a7f3-977a-498d-8b69-83e66e83a75a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50982024-08-28T23:35:35.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8430a7f3-977a-498d-8b69-83e66e83a75a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
50992024-08-28T23:35:36.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 356410f1-d3da-4a07-8fc1-fcb73df23bf4 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51002024-08-28T23:35:36.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 356410f1-d3da-4a07-8fc1-fcb73df23bf4 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51012024-08-28T23:35:36.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 356410f1-d3da-4a07-8fc1-fcb73df23bf4 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51022024-08-28T23:35:37.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3277f5f4-ee2b-443c-847f-7a834381e86f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51032024-08-28T23:35:37.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3277f5f4-ee2b-443c-847f-7a834381e86f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51042024-08-28T23:35:37.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3277f5f4-ee2b-443c-847f-7a834381e86f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51052024-08-28T23:35:38.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 79654bb9-b350-447d-8220-555c7306d506 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51062024-08-28T23:35:38.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 79654bb9-b350-447d-8220-555c7306d506 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51072024-08-28T23:35:38.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 79654bb9-b350-447d-8220-555c7306d506 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51082024-08-28T23:35:39.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2987d716-26cc-4d32-b470-3cbc86205de8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51092024-08-28T23:35:39.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2987d716-26cc-4d32-b470-3cbc86205de8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51102024-08-28T23:35:39.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2987d716-26cc-4d32-b470-3cbc86205de8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51112024-08-28T23:35:40.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8cf901c-ae9a-4f79-ad34-ec6da90cf167 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51122024-08-28T23:35:40.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8cf901c-ae9a-4f79-ad34-ec6da90cf167 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51132024-08-28T23:35:40.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b8cf901c-ae9a-4f79-ad34-ec6da90cf167 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51142024-08-28T23:35:41.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82ffad04-ea81-4abe-81f6-2f47128ed3bd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51152024-08-28T23:35:41.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82ffad04-ea81-4abe-81f6-2f47128ed3bd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51162024-08-28T23:35:41.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 82ffad04-ea81-4abe-81f6-2f47128ed3bd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51172024-08-28T23:35:42.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
51182024-08-28T23:35:42.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51192024-08-28T23:35:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51202024-08-28T23:35:42.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
51212024-08-28T23:35:42.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51222024-08-28T23:35:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51232024-08-28T23:35:42.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242024-08-28T23:35:42.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51252024-08-28T23:35:42.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51262024-08-28T23:35:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51272024-08-28T23:35:42.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51282024-08-28T23:35:42.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.541134ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51292024-08-28T23:35:42.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51302024-08-28T23:35:42.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51312024-08-28T23:35:42.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51322024-08-28T23:35:42.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51332024-08-28T23:35:42.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
51342024-08-28T23:35:42.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51352024-08-28T23:35:42.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51362024-08-28T23:35:42.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
51372024-08-28T23:35:42.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.516949ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
51382024-08-28T23:35:42.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8de2e7f8-7073-44ab-a984-dec021782229 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51392024-08-28T23:35:42.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8de2e7f8-7073-44ab-a984-dec021782229 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51402024-08-28T23:35:42.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8de2e7f8-7073-44ab-a984-dec021782229 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51412024-08-28T23:35:42.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 877 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = d51e29c9-ce7c-4ebe-9545-f828952456b4 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
51422024-08-28T23:35:43.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 69a8b5f7-d5bf-4638-b02a-bdedd2301887 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51432024-08-28T23:35:43.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 69a8b5f7-d5bf-4638-b02a-bdedd2301887 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51442024-08-28T23:35:43.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 69a8b5f7-d5bf-4638-b02a-bdedd2301887 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51452024-08-28T23:35:44.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c2a6ef-6ec9-488a-a4d8-79ecbc4d69fc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51462024-08-28T23:35:44.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c2a6ef-6ec9-488a-a4d8-79ecbc4d69fc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51472024-08-28T23:35:44.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c3c2a6ef-6ec9-488a-a4d8-79ecbc4d69fc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51482024-08-28T23:35:45.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a951bd1a-5567-45d7-95c1-c5b1b49249af roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51492024-08-28T23:35:45.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a951bd1a-5567-45d7-95c1-c5b1b49249af resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51502024-08-28T23:35:45.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a951bd1a-5567-45d7-95c1-c5b1b49249af response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51512024-08-28T23:35:46.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e3d7270-8666-41a2-98cf-04c7b54214df roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51522024-08-28T23:35:46.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e3d7270-8666-41a2-98cf-04c7b54214df resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51532024-08-28T23:35:46.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e3d7270-8666-41a2-98cf-04c7b54214df response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51542024-08-28T23:35:47.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8661779a-3551-4d7f-b808-9bbb645c7fa2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51552024-08-28T23:35:47.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8661779a-3551-4d7f-b808-9bbb645c7fa2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51562024-08-28T23:35:47.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8661779a-3551-4d7f-b808-9bbb645c7fa2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51572024-08-28T23:35:48.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a27f3542-ea4b-4e19-b37d-b70d1458e9c2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51582024-08-28T23:35:48.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a27f3542-ea4b-4e19-b37d-b70d1458e9c2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51592024-08-28T23:35:48.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a27f3542-ea4b-4e19-b37d-b70d1458e9c2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51602024-08-28T23:35:49.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50df7516-d945-4fcb-995f-26b30fe5eec5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51612024-08-28T23:35:49.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50df7516-d945-4fcb-995f-26b30fe5eec5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51622024-08-28T23:35:49.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50df7516-d945-4fcb-995f-26b30fe5eec5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51632024-08-28T23:35:50.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c18345-7be6-45c4-a258-e228b4009c57 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51642024-08-28T23:35:50.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c18345-7be6-45c4-a258-e228b4009c57 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51652024-08-28T23:35:50.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c18345-7be6-45c4-a258-e228b4009c57 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51662024-08-28T23:35:51.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce28d346-53c7-4192-ab5e-ec4e5be7abef roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51672024-08-28T23:35:51.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce28d346-53c7-4192-ab5e-ec4e5be7abef resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51682024-08-28T23:35:51.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ce28d346-53c7-4192-ab5e-ec4e5be7abef response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
51692024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
51702024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
51712024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51722024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
51732024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
51742024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
51752024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
51762024-08-28T23:35:52.089ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
51772024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
51782024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.2\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
51792024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
51802024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51812024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
51822024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
51832024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51842024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51852024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51862024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
51872024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51882024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
51892024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51902024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
51912024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51922024-08-28T23:35:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51932024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51942024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51952024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51962024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51972024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51982024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51992024-08-28T23:35:52.090ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 871664820 } })
52002024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52012024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
52022024-08-28T23:35:52.090ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 871753271 } })
52032024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
52042024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52052024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
52062024-08-28T23:35:52.090ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:25:52.090316809 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52072024-08-28T23:35:52.090ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52082024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52092024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52102024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
52112024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
52122024-08-28T23:35:52.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
52132024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52142024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52152024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
52162024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
52172024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52182024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52192024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
52202024-08-28T23:35:52.090ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
52212024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52222024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
52232024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52242024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
52252024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
52262024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52272024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52282024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
52292024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52302024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
52312024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52322024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
52332024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52342024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52352024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
52362024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52372024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52382024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52392024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52402024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52412024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52422024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52432024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52442024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52452024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52462024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52472024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52482024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52492024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52502024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52512024-08-28T23:35:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52522024-08-28T23:35:52.092ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.692649ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52532024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52542024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52552024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52562024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
52572024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
52582024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.814359ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
52592024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.766039ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
52602024-08-28T23:35:52.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52612024-08-28T23:35:52.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 876196102 } })
52622024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52632024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52642024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52652024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52662024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52672024-08-28T23:35:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52682024-08-28T23:35:52.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
52692024-08-28T23:35:52.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52702024-08-28T23:35:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52712024-08-28T23:35:52.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 880086763 } })
52722024-08-28T23:35:52.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-08-28T23:35:52.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
52742024-08-28T23:35:52.100ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:25:52.090316809 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52752024-08-28T23:35:52.100ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.257287ms iteration = 9 status = {"expiration":"2024-08-28T23:25:52.090316809Z","pruned":[]}
52762024-08-28T23:35:52.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52772024-08-28T23:35:52.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52782024-08-28T23:35:52.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52792024-08-28T23:35:52.106ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.541112ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
52802024-08-28T23:35:52.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812024-08-28T23:35:52.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52822024-08-28T23:35:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52832024-08-28T23:35:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52842024-08-28T23:35:52.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52852024-08-28T23:35:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52862024-08-28T23:35:52.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52872024-08-28T23:35:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52882024-08-28T23:35:52.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52892024-08-28T23:35:52.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902024-08-28T23:35:52.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52912024-08-28T23:35:52.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52922024-08-28T23:35:52.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52932024-08-28T23:35:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52942024-08-28T23:35:52.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52952024-08-28T23:35:52.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 900992614 } })
52962024-08-28T23:35:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52972024-08-28T23:35:52.119ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
52982024-08-28T23:35:52.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992024-08-28T23:35:52.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53002024-08-28T23:35:52.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53012024-08-28T23:35:52.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022024-08-28T23:35:52.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53032024-08-28T23:35:52.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53042024-08-28T23:35:52.143ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
53052024-08-28T23:35:52.143ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53062024-08-28T23:35:52.143ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53072024-08-28T23:35:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53082024-08-28T23:35:52.145ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53092024-08-28T23:35:52.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53102024-08-28T23:35:52.146ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53112024-08-28T23:35:52.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53122024-08-28T23:35:52.147ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
53132024-08-28T23:35:52.147ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
53142024-08-28T23:35:52.147ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.423436ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
53152024-08-28T23:35:52.149ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162024-08-28T23:35:52.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53172024-08-28T23:35:52.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182024-08-28T23:35:52.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53192024-08-28T23:35:52.153ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53202024-08-28T23:35:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53212024-08-28T23:35:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53222024-08-28T23:35:52.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53232024-08-28T23:35:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53242024-08-28T23:35:52.154ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252024-08-28T23:35:52.155ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53262024-08-28T23:35:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53272024-08-28T23:35:52.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53282024-08-28T23:35:52.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53292024-08-28T23:35:52.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53302024-08-28T23:35:52.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53312024-08-28T23:35:52.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.193634ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
53322024-08-28T23:35:52.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53332024-08-28T23:35:52.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53342024-08-28T23:35:52.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352024-08-28T23:35:52.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53362024-08-28T23:35:52.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53372024-08-28T23:35:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53382024-08-28T23:35:52.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53392024-08-28T23:35:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53402024-08-28T23:35:52.198ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53412024-08-28T23:35:52.198ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53422024-08-28T23:35:52.198ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53432024-08-28T23:35:52.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53442024-08-28T23:35:52.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53452024-08-28T23:35:52.209ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53462024-08-28T23:35:52.209ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53472024-08-28T23:35:52.209ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53482024-08-28T23:35:52.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53492024-08-28T23:35:52.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53502024-08-28T23:35:52.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53512024-08-28T23:35:52.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53522024-08-28T23:35:52.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53532024-08-28T23:35:52.264ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.871086ms iteration = 19 status = {"physical_disks_added":0}
53542024-08-28T23:35:52.278ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53552024-08-28T23:35:52.278ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53562024-08-28T23:35:52.278ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed8242d-d358-41c8-979a-899510053635", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
53572024-08-28T23:35:52.278ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53582024-08-28T23:35:52.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53592024-08-28T23:35:52.288ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53602024-08-28T23:35:52.300ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
53612024-08-28T23:35:52.300ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53622024-08-28T23:35:52.301ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "592a7474-a9e6-4f7a-81eb-8c7046ea2080", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
53632024-08-28T23:35:52.301ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53642024-08-28T23:35:52.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
53652024-08-28T23:35:52.416ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53662024-08-28T23:35:52.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53672024-08-28T23:35:52.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "719a9d93-e13d-4564-8d38-5910b5bbbc5f", "content-length": "372", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
53682024-08-28T23:35:52.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53692024-08-28T23:35:52.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53702024-08-28T23:35:52.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53712024-08-28T23:35:52.428ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53722024-08-28T23:35:52.429ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5bf94b66-87d6-4d2b-9c9d-68d80ca768b4", "content-length": "26", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
53732024-08-28T23:35:52.429ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53742024-08-28T23:35:52.432ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53752024-08-28T23:35:52.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53762024-08-28T23:35:52.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53772024-08-28T23:35:52.433ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.578939ms iteration = 17 status = {}
53782024-08-28T23:35:52.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53792024-08-28T23:35:52.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53802024-08-28T23:35:52.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53812024-08-28T23:35:52.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53822024-08-28T23:35:52.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53832024-08-28T23:35:52.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53842024-08-28T23:35:52.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53852024-08-28T23:35:52.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53862024-08-28T23:35:52.444ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53872024-08-28T23:35:52.444ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66129201-0f79-4caf-b8d9-0c2e3aa74a17", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
53882024-08-28T23:35:52.445ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 355.608448ms iteration = 18 status = {}
53892024-08-28T23:35:52.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53902024-08-28T23:35:52.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53912024-08-28T23:35:52.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53922024-08-28T23:35:52.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53932024-08-28T23:35:52.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-08-28T23:35:52.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 375.299668ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
53952024-08-28T23:35:52.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 376.334296ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53962024-08-28T23:35:52.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53972024-08-28T23:35:52.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53982024-08-28T23:35:52.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53992024-08-28T23:35:52.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
54002024-08-28T23:35:52.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54012024-08-28T23:35:52.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 378.238501ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54022024-08-28T23:35:52.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54032024-08-28T23:35:52.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042024-08-28T23:35:52.469ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54052024-08-28T23:35:52.469ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54062024-08-28T23:35:52.469ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 379.231949ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54072024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
54082024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54092024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54102024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54112024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54122024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54132024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54142024-08-28T23:35:52.471ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54152024-08-28T23:35:52.471ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 381.433809ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54162024-08-28T23:35:52.472ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54172024-08-28T23:35:52.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54182024-08-28T23:35:52.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192024-08-28T23:35:52.473ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 383.065389ms iteration = 17 status = 0
54202024-08-28T23:35:52.476ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54212024-08-28T23:35:52.476ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "387ab649-b5d0-40db-bd59-7ac129d5fb13", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54222024-08-28T23:35:52.476ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54232024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54242024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54252024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54262024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54272024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54282024-08-28T23:35:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54292024-08-28T23:35:52.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54302024-08-28T23:35:52.479ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "86a22350-e6a9-4686-93a1-f94115e0af7f", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54312024-08-28T23:35:52.479ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54322024-08-28T23:35:52.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332024-08-28T23:35:52.481ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54342024-08-28T23:35:52.481ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.930341ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54352024-08-28T23:35:52.482ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
54362024-08-28T23:35:52.482ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 392.763366ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
54372024-08-28T23:35:52.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54382024-08-28T23:35:52.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54392024-08-28T23:35:52.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54402024-08-28T23:35:52.485ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
54412024-08-28T23:35:52.485ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54422024-08-28T23:35:52.485ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
54432024-08-28T23:35:52.485ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 395.579847ms iteration = 9 status = {"generation":1}
54442024-08-28T23:35:52.501ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54452024-08-28T23:35:52.501ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 410.661182ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54462024-08-28T23:35:52.504ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54472024-08-28T23:35:52.504ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
54482024-08-28T23:35:52.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54492024-08-28T23:35:52.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54502024-08-28T23:35:52.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54512024-08-28T23:35:52.506ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
54522024-08-28T23:35:52.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 416.5799ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54532024-08-28T23:35:52.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54542024-08-28T23:35:52.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54552024-08-28T23:35:52.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54562024-08-28T23:35:52.509ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
54572024-08-28T23:35:52.509ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 419.991682ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54582024-08-28T23:35:52.511ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
54592024-08-28T23:35:52.511ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54602024-08-28T23:35:52.511ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
54612024-08-28T23:35:52.511ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 421.948297ms iteration = 9 status = {"generation":2}
54622024-08-28T23:35:52.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54632024-08-28T23:35:52.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54642024-08-28T23:35:52.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652024-08-28T23:35:52.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54662024-08-28T23:35:52.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54672024-08-28T23:35:52.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54682024-08-28T23:35:52.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-08-28T23:35:52.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54702024-08-28T23:35:52.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54712024-08-28T23:35:52.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54722024-08-28T23:35:52.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54732024-08-28T23:35:52.547ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b2f61a2d-50ec-4e0d-b8c1-81600e0d05fb", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54742024-08-28T23:35:52.547ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54752024-08-28T23:35:52.548ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c382fa2-c9fe-4e38-91df-e59a587ce43c", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54762024-08-28T23:35:52.548ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54772024-08-28T23:35:52.550ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "245a3192-118f-42db-8184-c8ca23a5efb9", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54782024-08-28T23:35:52.550ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54792024-08-28T23:35:52.552ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54802024-08-28T23:35:52.552ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.757571ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54812024-08-28T23:35:52.621ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54822024-08-28T23:35:52.621ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8e40d5bc-03d6-4f7d-8e6d-06f8c2b417da", "content-length": "2", "date": "Wed, 28 Aug 2024 23:35:51 GMT"} })
54832024-08-28T23:35:52.623ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54842024-08-28T23:35:52.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54852024-08-28T23:35:52.625ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.107877ms iteration = 17 status = null
54862024-08-28T23:35:52.665ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54872024-08-28T23:35:52.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0e84e5b8-22c2-4478-a9aa-8ca328e93a18", "content-length": "691", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
54882024-08-28T23:35:52.666ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54892024-08-28T23:35:52.666ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54902024-08-28T23:35:52.666ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54912024-08-28T23:35:52.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 577.483711ms iteration = 18 status = {}
54922024-08-28T23:35:52.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54932024-08-28T23:35:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54942024-08-28T23:35:52.688ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
54952024-08-28T23:35:52.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54962024-08-28T23:35:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54972024-08-28T23:35:52.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54982024-08-28T23:35:52.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56d76008-d588-4756-823f-2e48a3dca108", "content-length": "121", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
54992024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
55002024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
55012024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55022024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55032024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
55042024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
55052024-08-28T23:35:52.697ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
55062024-08-28T23:35:52.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55072024-08-28T23:35:52.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55082024-08-28T23:35:52.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55092024-08-28T23:35:52.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07182f67-001e-42b5-a53a-2dfb556ac42b", "content-length": "2", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
55102024-08-28T23:35:52.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55112024-08-28T23:35:52.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0459a788-71c5-41d4-8874-c47d1c25f2ee", "content-length": "52", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
55122024-08-28T23:35:52.699ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
55132024-08-28T23:35:52.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55142024-08-28T23:35:52.794ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "21c352fd-3597-44eb-b072-ec4b8632e2d4", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
55152024-08-28T23:35:52.794ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
55162024-08-28T23:35:52.794ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55172024-08-28T23:35:52.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b14b6701-9ec7-4cf5-b0d7-17f7820f2e48 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55182024-08-28T23:35:52.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b14b6701-9ec7-4cf5-b0d7-17f7820f2e48 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55192024-08-28T23:35:52.795ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "babacb44-e000-4a4b-955a-9cc010ae86b5", "content-length": "667", "date": "Wed, 28 Aug 2024 23:35:52 GMT"} })
55202024-08-28T23:35:52.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55212024-08-28T23:35:52.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55222024-08-28T23:35:52.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b14b6701-9ec7-4cf5-b0d7-17f7820f2e48 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55232024-08-28T23:35:52.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55242024-08-28T23:35:52.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55252024-08-28T23:35:52.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55262024-08-28T23:35:52.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55272024-08-28T23:35:52.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55282024-08-28T23:35:52.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55292024-08-28T23:35:52.811ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 720.577959ms iteration = 17 status = {}
55302024-08-28T23:35:52.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 571 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 1567e6db-ee66-464f-b7ea-2a76c3fe367f response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
55312024-08-28T23:35:53.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5fedd0fb-422c-4277-97f4-a0b969836878 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55322024-08-28T23:35:53.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5fedd0fb-422c-4277-97f4-a0b969836878 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55332024-08-28T23:35:53.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5fedd0fb-422c-4277-97f4-a0b969836878 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55342024-08-28T23:35:54.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 775da013-b1cd-4f01-9976-3489d666dc18 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55352024-08-28T23:35:54.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 775da013-b1cd-4f01-9976-3489d666dc18 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55362024-08-28T23:35:54.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 775da013-b1cd-4f01-9976-3489d666dc18 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55372024-08-28T23:35:55.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3caa4189-f9d5-47d9-8c8b-5b644619b032 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55382024-08-28T23:35:55.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3caa4189-f9d5-47d9-8c8b-5b644619b032 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55392024-08-28T23:35:55.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3caa4189-f9d5-47d9-8c8b-5b644619b032 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55402024-08-28T23:35:56.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c1e407f-7e75-45c9-b0d1-f300575ad3cd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55412024-08-28T23:35:56.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c1e407f-7e75-45c9-b0d1-f300575ad3cd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55422024-08-28T23:35:56.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4c1e407f-7e75-45c9-b0d1-f300575ad3cd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55432024-08-28T23:35:57.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 007b3d04-2ccd-483a-97e6-4ed776c978ca roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55442024-08-28T23:35:57.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 007b3d04-2ccd-483a-97e6-4ed776c978ca resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55452024-08-28T23:35:57.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 007b3d04-2ccd-483a-97e6-4ed776c978ca response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55462024-08-28T23:35:58.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62f6fc7b-2e5d-4685-812a-32228e6c9a94 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55472024-08-28T23:35:58.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62f6fc7b-2e5d-4685-812a-32228e6c9a94 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55482024-08-28T23:35:58.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 62f6fc7b-2e5d-4685-812a-32228e6c9a94 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55492024-08-28T23:35:59.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 661f9bad-bc5c-44e4-8476-23a6e6c77826 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55502024-08-28T23:35:59.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 661f9bad-bc5c-44e4-8476-23a6e6c77826 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55512024-08-28T23:35:59.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 661f9bad-bc5c-44e4-8476-23a6e6c77826 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55522024-08-28T23:36:00.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e316741-e7c6-470a-8736-cc029baa1d1c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55532024-08-28T23:36:00.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e316741-e7c6-470a-8736-cc029baa1d1c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55542024-08-28T23:36:00.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8e316741-e7c6-470a-8736-cc029baa1d1c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55552024-08-28T23:36:01.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4eee8354-5da8-4530-ab01-6808b0a02f66 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55562024-08-28T23:36:01.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4eee8354-5da8-4530-ab01-6808b0a02f66 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55572024-08-28T23:36:01.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4eee8354-5da8-4530-ab01-6808b0a02f66 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55582024-08-28T23:36:02.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
55592024-08-28T23:36:02.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55602024-08-28T23:36:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55612024-08-28T23:36:02.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
55622024-08-28T23:36:02.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55632024-08-28T23:36:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55642024-08-28T23:36:02.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-08-28T23:36:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55662024-08-28T23:36:02.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55672024-08-28T23:36:02.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55682024-08-28T23:36:02.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55692024-08-28T23:36:02.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55702024-08-28T23:36:02.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55712024-08-28T23:36:02.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
55722024-08-28T23:36:02.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55732024-08-28T23:36:02.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55742024-08-28T23:36:02.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
55752024-08-28T23:36:02.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.455615ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
55762024-08-28T23:36:02.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55772024-08-28T23:36:02.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55782024-08-28T23:36:02.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.306556ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55792024-08-28T23:36:02.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 752 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 42f90191-93ff-4c65-bb32-5cdcbd62234d response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
55802024-08-28T23:36:03.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c3b688a-650b-4afc-9850-c77ffd724c36 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55812024-08-28T23:36:03.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c3b688a-650b-4afc-9850-c77ffd724c36 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55822024-08-28T23:36:03.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 1c3b688a-650b-4afc-9850-c77ffd724c36 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55832024-08-28T23:36:04.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5b403fc-f31f-4ab0-8ec1-195d875e60f5 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55842024-08-28T23:36:04.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5b403fc-f31f-4ab0-8ec1-195d875e60f5 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55852024-08-28T23:36:04.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a5b403fc-f31f-4ab0-8ec1-195d875e60f5 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55862024-08-28T23:36:05.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bff61fd7-fa65-44d4-ae37-456e63fa4944 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55872024-08-28T23:36:05.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bff61fd7-fa65-44d4-ae37-456e63fa4944 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55882024-08-28T23:36:05.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bff61fd7-fa65-44d4-ae37-456e63fa4944 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55892024-08-28T23:36:06.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c775db4b-736b-434f-a4fb-c23fd5369360 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55902024-08-28T23:36:06.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c775db4b-736b-434f-a4fb-c23fd5369360 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55912024-08-28T23:36:06.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c775db4b-736b-434f-a4fb-c23fd5369360 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55922024-08-28T23:36:07.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 77de25eb-4b91-4f2e-8d86-acedbe54c998 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55932024-08-28T23:36:07.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 77de25eb-4b91-4f2e-8d86-acedbe54c998 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55942024-08-28T23:36:07.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 77de25eb-4b91-4f2e-8d86-acedbe54c998 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55952024-08-28T23:36:08.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9f6f3f8-c0c2-4165-9876-f81c5ee1004a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55962024-08-28T23:36:08.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9f6f3f8-c0c2-4165-9876-f81c5ee1004a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55972024-08-28T23:36:08.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c9f6f3f8-c0c2-4165-9876-f81c5ee1004a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55982024-08-28T23:36:09.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96b5682a-7033-4d3c-a34a-7ce739e2a9a6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
55992024-08-28T23:36:09.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96b5682a-7033-4d3c-a34a-7ce739e2a9a6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56002024-08-28T23:36:09.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 96b5682a-7033-4d3c-a34a-7ce739e2a9a6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56012024-08-28T23:36:10.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38051c98-e11d-4f6b-8d2b-92b3428630f9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56022024-08-28T23:36:10.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38051c98-e11d-4f6b-8d2b-92b3428630f9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56032024-08-28T23:36:10.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 38051c98-e11d-4f6b-8d2b-92b3428630f9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56042024-08-28T23:36:11.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc082486-2da0-4a38-962a-c352568a399f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56052024-08-28T23:36:11.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc082486-2da0-4a38-962a-c352568a399f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56062024-08-28T23:36:11.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc082486-2da0-4a38-962a-c352568a399f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56072024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
56082024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56092024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56102024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
56112024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56122024-08-28T23:36:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56132024-08-28T23:36:12.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56142024-08-28T23:36:12.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56152024-08-28T23:36:12.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56162024-08-28T23:36:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56172024-08-28T23:36:12.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56182024-08-28T23:36:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56192024-08-28T23:36:12.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56202024-08-28T23:36:12.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56212024-08-28T23:36:12.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56222024-08-28T23:36:12.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.334244ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56232024-08-28T23:36:12.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
56242024-08-28T23:36:12.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56252024-08-28T23:36:12.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56262024-08-28T23:36:12.135ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
56272024-08-28T23:36:12.135ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.795955ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
56282024-08-28T23:36:12.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 86f90979-a6e9-4ca8-a27b-7e114589b6d0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56292024-08-28T23:36:12.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 86f90979-a6e9-4ca8-a27b-7e114589b6d0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56302024-08-28T23:36:12.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 86f90979-a6e9-4ca8-a27b-7e114589b6d0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56312024-08-28T23:36:12.929ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 894 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 5b6de1e9-1aa2-488c-babe-ab058e81983b response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
56322024-08-28T23:36:13.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7697ca3e-ccc7-44ec-8b01-6082f88b2d3f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56332024-08-28T23:36:13.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7697ca3e-ccc7-44ec-8b01-6082f88b2d3f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56342024-08-28T23:36:13.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7697ca3e-ccc7-44ec-8b01-6082f88b2d3f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56352024-08-28T23:36:14.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 622adf6e-f527-42c3-bde9-2538a043ae25 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56362024-08-28T23:36:14.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 622adf6e-f527-42c3-bde9-2538a043ae25 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56372024-08-28T23:36:14.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 622adf6e-f527-42c3-bde9-2538a043ae25 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56382024-08-28T23:36:15.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78643e90-cdbe-47cb-9b3b-5cad0973fb59 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56392024-08-28T23:36:15.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78643e90-cdbe-47cb-9b3b-5cad0973fb59 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56402024-08-28T23:36:15.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78643e90-cdbe-47cb-9b3b-5cad0973fb59 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56412024-08-28T23:36:16.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 23d1293c-2342-4ba7-b5a3-9b1067a41443 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56422024-08-28T23:36:16.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 23d1293c-2342-4ba7-b5a3-9b1067a41443 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56432024-08-28T23:36:16.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 23d1293c-2342-4ba7-b5a3-9b1067a41443 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56442024-08-28T23:36:17.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a18c7b63-d92c-4b70-8fe3-514f63d5f54a roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56452024-08-28T23:36:17.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a18c7b63-d92c-4b70-8fe3-514f63d5f54a resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56462024-08-28T23:36:17.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a18c7b63-d92c-4b70-8fe3-514f63d5f54a response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56472024-08-28T23:36:18.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8654213-b09d-4669-addb-de61478312cf roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56482024-08-28T23:36:18.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8654213-b09d-4669-addb-de61478312cf resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56492024-08-28T23:36:18.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a8654213-b09d-4669-addb-de61478312cf response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56502024-08-28T23:36:19.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b6374892-c9cb-4902-b331-cb24935a5cdf roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56512024-08-28T23:36:19.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b6374892-c9cb-4902-b331-cb24935a5cdf resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56522024-08-28T23:36:19.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b6374892-c9cb-4902-b331-cb24935a5cdf response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56532024-08-28T23:36:20.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fedce05f-194f-4e50-a091-2f8a955c36f7 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56542024-08-28T23:36:20.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fedce05f-194f-4e50-a091-2f8a955c36f7 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56552024-08-28T23:36:20.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = fedce05f-194f-4e50-a091-2f8a955c36f7 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56562024-08-28T23:36:21.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 300c3999-c644-42f9-8f92-17fa57b3983e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56572024-08-28T23:36:21.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 300c3999-c644-42f9-8f92-17fa57b3983e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56582024-08-28T23:36:21.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 300c3999-c644-42f9-8f92-17fa57b3983e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
56592024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
56602024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
56612024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56622024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
56632024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
56642024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
56652024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56662024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56672024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56692024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56702024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56712024-08-28T23:36:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56722024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
56732024-08-28T23:36:22.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
56742024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
56752024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56762024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56772024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
56782024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56792024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
56802024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56812024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56822024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
56832024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
56842024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
56852024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56862024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56872024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56882024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
56892024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
56902024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56912024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56922024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
56932024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56942024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
56952024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56962024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56972024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56982024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56992024-08-28T23:36:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57002024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57012024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57022024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57032024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57042024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57052024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57062024-08-28T23:36:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57072024-08-28T23:36:22.092ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 873839479 } })
57082024-08-28T23:36:22.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57092024-08-28T23:36:22.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102024-08-28T23:36:22.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112024-08-28T23:36:22.093ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.872371ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57122024-08-28T23:36:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 875204144 } })
57132024-08-28T23:36:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57142024-08-28T23:36:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57152024-08-28T23:36:22.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57162024-08-28T23:36:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57172024-08-28T23:36:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57182024-08-28T23:36:22.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57192024-08-28T23:36:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57202024-08-28T23:36:22.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57212024-08-28T23:36:22.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.9169ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
57222024-08-28T23:36:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57232024-08-28T23:36:22.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57242024-08-28T23:36:22.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57252024-08-28T23:36:22.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57262024-08-28T23:36:22.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57272024-08-28T23:36:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57282024-08-28T23:36:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57292024-08-28T23:36:22.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57302024-08-28T23:36:22.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57312024-08-28T23:36:22.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322024-08-28T23:36:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57332024-08-28T23:36:22.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57342024-08-28T23:36:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57352024-08-28T23:36:22.121ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57362024-08-28T23:36:22.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57372024-08-28T23:36:22.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57382024-08-28T23:36:22.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57392024-08-28T23:36:22.124ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
57402024-08-28T23:36:22.124ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57412024-08-28T23:36:22.124ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57422024-08-28T23:36:22.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57432024-08-28T23:36:22.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57442024-08-28T23:36:22.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57452024-08-28T23:36:22.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57462024-08-28T23:36:22.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57472024-08-28T23:36:22.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57482024-08-28T23:36:22.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57492024-08-28T23:36:22.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57502024-08-28T23:36:22.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57512024-08-28T23:36:22.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57522024-08-28T23:36:22.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57532024-08-28T23:36:22.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-08-28T23:36:22.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57552024-08-28T23:36:22.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57562024-08-28T23:36:22.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57572024-08-28T23:36:22.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57582024-08-28T23:36:22.132ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57592024-08-28T23:36:22.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57602024-08-28T23:36:22.132ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 914175304 } })
57612024-08-28T23:36:22.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622024-08-28T23:36:22.133ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
57632024-08-28T23:36:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
57642024-08-28T23:36:22.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57652024-08-28T23:36:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57662024-08-28T23:36:22.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57672024-08-28T23:36:22.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57682024-08-28T23:36:22.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57692024-08-28T23:36:22.138ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.627228ms iteration = 18 status = 0
57702024-08-28T23:36:22.141ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57712024-08-28T23:36:22.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57722024-08-28T23:36:22.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732024-08-28T23:36:22.142ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57742024-08-28T23:36:22.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57752024-08-28T23:36:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
57762024-08-28T23:36:22.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57772024-08-28T23:36:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57782024-08-28T23:36:22.165ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
57792024-08-28T23:36:22.165ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.447693ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
57802024-08-28T23:36:22.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.248195ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57812024-08-28T23:36:22.177ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
57822024-08-28T23:36:22.177ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57832024-08-28T23:36:22.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.565077ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
57842024-08-28T23:36:22.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
57852024-08-28T23:36:22.182ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57862024-08-28T23:36:22.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.569829ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
57872024-08-28T23:36:22.182ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a445f1d1-aaad-4857-a060-b5c38ce33222", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
57882024-08-28T23:36:22.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57892024-08-28T23:36:22.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57902024-08-28T23:36:22.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
57912024-08-28T23:36:22.184ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57922024-08-28T23:36:22.185ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf86ff00-a6f1-4761-b0f9-a483508db696", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
57932024-08-28T23:36:22.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57942024-08-28T23:36:22.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57952024-08-28T23:36:22.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57962024-08-28T23:36:22.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57972024-08-28T23:36:22.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.088713ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57982024-08-28T23:36:22.217ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57992024-08-28T23:36:22.217ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.34199ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58002024-08-28T23:36:22.227ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
58012024-08-28T23:36:22.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.392413ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58022024-08-28T23:36:22.235ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.808036ms iteration = 20 status = {"physical_disks_added":0}
58032024-08-28T23:36:22.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58042024-08-28T23:36:22.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58052024-08-28T23:36:22.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58062024-08-28T23:36:22.265ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71496549-5372-4c36-8472-a9dbbaa5b013", "content-length": "372", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58072024-08-28T23:36:22.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58082024-08-28T23:36:22.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58092024-08-28T23:36:22.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58102024-08-28T23:36:22.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58112024-08-28T23:36:22.272ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
58122024-08-28T23:36:22.272ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58132024-08-28T23:36:22.272ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f0b38864-5677-41ae-938a-ebe24d55a140", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58142024-08-28T23:36:22.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58152024-08-28T23:36:22.274ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
58162024-08-28T23:36:22.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58172024-08-28T23:36:22.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58182024-08-28T23:36:22.285ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58192024-08-28T23:36:22.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cc4137c7-edcd-478c-a7c0-63f7a37eaa63", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58202024-08-28T23:36:22.288ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 197.675651ms iteration = 19 status = {}
58212024-08-28T23:36:22.289ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58222024-08-28T23:36:22.289ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ba9f349b-920d-4234-a305-5309332678c3", "content-length": "2", "date": "Wed, 28 Aug 2024 23:36:21 GMT"} })
58232024-08-28T23:36:22.291ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58242024-08-28T23:36:22.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58252024-08-28T23:36:22.293ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.463995ms iteration = 18 status = null
58262024-08-28T23:36:22.299ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.846754ms iteration = 18 status = {}
58272024-08-28T23:36:22.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58282024-08-28T23:36:22.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58292024-08-28T23:36:22.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58302024-08-28T23:36:22.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58312024-08-28T23:36:22.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58322024-08-28T23:36:22.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58332024-08-28T23:36:22.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58342024-08-28T23:36:22.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58352024-08-28T23:36:22.390ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
58362024-08-28T23:36:22.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58372024-08-28T23:36:22.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58382024-08-28T23:36:22.400ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58392024-08-28T23:36:22.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e77c6b3-f318-4de6-b681-1257eec59461", "content-length": "121", "date": "Wed, 28 Aug 2024 23:36:21 GMT"} })
58402024-08-28T23:36:22.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
58412024-08-28T23:36:22.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
58422024-08-28T23:36:22.401ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58432024-08-28T23:36:22.401ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58442024-08-28T23:36:22.401ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
58452024-08-28T23:36:22.401ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
58462024-08-28T23:36:22.401ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
58472024-08-28T23:36:22.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58482024-08-28T23:36:22.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58492024-08-28T23:36:22.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58502024-08-28T23:36:22.404ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a9f98a-3240-41d1-a97b-40a34bd6f39c", "content-length": "2", "date": "Wed, 28 Aug 2024 23:36:21 GMT"} })
58512024-08-28T23:36:22.404ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58522024-08-28T23:36:22.404ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a89fa9be-6561-4496-bd81-65dc4ceb80eb", "content-length": "52", "date": "Wed, 28 Aug 2024 23:36:21 GMT"} })
58532024-08-28T23:36:22.404ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
58542024-08-28T23:36:22.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58552024-08-28T23:36:22.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562024-08-28T23:36:22.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58572024-08-28T23:36:22.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58582024-08-28T23:36:22.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58592024-08-28T23:36:22.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4a3a58ee-627e-468b-a9b5-d48b32b39cac roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
58602024-08-28T23:36:22.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4a3a58ee-627e-468b-a9b5-d48b32b39cac resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
58612024-08-28T23:36:22.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4a3a58ee-627e-468b-a9b5-d48b32b39cac response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
58622024-08-28T23:36:22.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58632024-08-28T23:36:22.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "84ace9e5-7317-4a32-8727-43ecd6fffc4d", "content-length": "691", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58642024-08-28T23:36:22.501ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58652024-08-28T23:36:22.501ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58662024-08-28T23:36:22.501ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58672024-08-28T23:36:22.502ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 412.013486ms iteration = 19 status = {}
58682024-08-28T23:36:22.562ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66f258bd-6e2b-4aed-ac18-a6c9a77645e3", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58692024-08-28T23:36:22.562ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
58702024-08-28T23:36:22.562ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58712024-08-28T23:36:22.562ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc399ab9-2f96-48f4-8731-4d30a106a8da", "content-length": "667", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58722024-08-28T23:36:22.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58732024-08-28T23:36:22.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58742024-08-28T23:36:22.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58752024-08-28T23:36:22.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58762024-08-28T23:36:22.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58772024-08-28T23:36:22.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58782024-08-28T23:36:22.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58792024-08-28T23:36:22.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58802024-08-28T23:36:22.580ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.691422ms iteration = 18 status = {}
58812024-08-28T23:36:22.928ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1179 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = f6eecb0d-eb94-4722-8970-1c0a27922027 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
58822024-08-28T23:36:22.931ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
58832024-08-28T23:36:22.931ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
58842024-08-28T23:36:22.962ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
58852024-08-28T23:36:22.962ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45258
58862024-08-28T23:36:22.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45258 req_id = a6e5edf7-9051-4a6b-93a6-fc71865d8ef4 roles = RoleSet { roles: {} } uri = /metrics/producers
58872024-08-28T23:36:22.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45258 req_id = a6e5edf7-9051-4a6b-93a6-fc71865d8ef4 resource = Database result = Ok(()) uri = /metrics/producers
58882024-08-28T23:36:22.995ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 099a839b-4790-447a-827a-80c4d38e82a0
58892024-08-28T23:36:22.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45258 req_id = a6e5edf7-9051-4a6b-93a6-fc71865d8ef4 roles = RoleSet { roles: {} } uri = /metrics/producers
58902024-08-28T23:36:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45258 req_id = a6e5edf7-9051-4a6b-93a6-fc71865d8ef4 resource = Database result = Ok(()) uri = /metrics/producers
58912024-08-28T23:36:23.026ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 uri = http://[fd00:1122:3344:101::d]:12223/producers
58922024-08-28T23:36:23.026ZDEBGnexus: client response oximeter-collector = 099a839b-4790-447a-827a-80c4d38e82a0 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7bbe4c37-4060-4162-9ff8-5893f8822434", "date": "Wed, 28 Aug 2024 23:36:23 GMT"} })
58932024-08-28T23:36:23.026ZINFOnexus: assigned collector to new producer collector_id = 099a839b-4790-447a-827a-80c4d38e82a0 file = nexus/src/app/oximeter.rs:125 producer_id = 424187fd-4660-4136-ae99-d26e8a3dc7ec
58942024-08-28T23:36:23.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64637 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45258 req_id = a6e5edf7-9051-4a6b-93a6-fc71865d8ef4 response_code = 201 uri = /metrics/producers
58952024-08-28T23:36:23.027ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "a6e5edf7-9051-4a6b-93a6-fc71865d8ef4", "content-length": "41", "date": "Wed, 28 Aug 2024 23:36:22 GMT"} })
58962024-08-28T23:36:23.028ZDEBGnexus (producer-registration-task): registered with nexus successfully
58972024-08-28T23:36:23.028ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
58982024-08-28T23:36:23.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ab5fb0-45a1-41e1-b0e1-385cd27c00cc roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
58992024-08-28T23:36:23.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ab5fb0-45a1-41e1-b0e1-385cd27c00cc resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59002024-08-28T23:36:23.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 33ab5fb0-45a1-41e1-b0e1-385cd27c00cc response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59012024-08-28T23:36:24.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af99eff9-1d0c-40c3-b167-a78ef2889ef8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59022024-08-28T23:36:24.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af99eff9-1d0c-40c3-b167-a78ef2889ef8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59032024-08-28T23:36:24.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = af99eff9-1d0c-40c3-b167-a78ef2889ef8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59042024-08-28T23:36:25.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78aa9489-a4e1-4102-aea0-47dac555ca78 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59052024-08-28T23:36:25.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78aa9489-a4e1-4102-aea0-47dac555ca78 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59062024-08-28T23:36:25.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 78aa9489-a4e1-4102-aea0-47dac555ca78 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59072024-08-28T23:36:26.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4b76928-11e1-458e-a3aa-ee26cdc87560 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59082024-08-28T23:36:26.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4b76928-11e1-458e-a3aa-ee26cdc87560 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59092024-08-28T23:36:26.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e4b76928-11e1-458e-a3aa-ee26cdc87560 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59102024-08-28T23:36:27.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd5c3197-a437-49f0-ad3a-04526ccaf70c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59112024-08-28T23:36:27.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd5c3197-a437-49f0-ad3a-04526ccaf70c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59122024-08-28T23:36:27.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd5c3197-a437-49f0-ad3a-04526ccaf70c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59132024-08-28T23:36:28.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 727f15bc-e819-4a5c-80ab-c802fc9c438c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59142024-08-28T23:36:28.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 727f15bc-e819-4a5c-80ab-c802fc9c438c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59152024-08-28T23:36:28.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 727f15bc-e819-4a5c-80ab-c802fc9c438c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59162024-08-28T23:36:29.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7100abf1-6c9c-431e-a068-d881bd259bb6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59172024-08-28T23:36:29.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7100abf1-6c9c-431e-a068-d881bd259bb6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59182024-08-28T23:36:29.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7100abf1-6c9c-431e-a068-d881bd259bb6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59192024-08-28T23:36:30.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 26449390-5575-49dc-87e4-89532b8d6102 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59202024-08-28T23:36:30.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 26449390-5575-49dc-87e4-89532b8d6102 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59212024-08-28T23:36:30.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 26449390-5575-49dc-87e4-89532b8d6102 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59222024-08-28T23:36:31.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 637c37fd-b470-4fa2-9863-6e36c9a5cccd roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59232024-08-28T23:36:31.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 637c37fd-b470-4fa2-9863-6e36c9a5cccd resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59242024-08-28T23:36:31.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 637c37fd-b470-4fa2-9863-6e36c9a5cccd response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59252024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
59262024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59272024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59282024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
59292024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59302024-08-28T23:36:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59312024-08-28T23:36:32.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322024-08-28T23:36:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59332024-08-28T23:36:32.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59342024-08-28T23:36:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59352024-08-28T23:36:32.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59362024-08-28T23:36:32.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59372024-08-28T23:36:32.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59382024-08-28T23:36:32.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59392024-08-28T23:36:32.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.415699ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59402024-08-28T23:36:32.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59412024-08-28T23:36:32.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
59422024-08-28T23:36:32.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59432024-08-28T23:36:32.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59442024-08-28T23:36:32.136ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
59452024-08-28T23:36:32.137ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.912804ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
59462024-08-28T23:36:32.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e68c9827-1dca-470f-811e-faa4ee16b297 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59472024-08-28T23:36:32.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e68c9827-1dca-470f-811e-faa4ee16b297 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59482024-08-28T23:36:32.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e68c9827-1dca-470f-811e-faa4ee16b297 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59492024-08-28T23:36:33.029ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 883 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 3ef06af4-f092-4dd5-be0c-1414ab190b03 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
59502024-08-28T23:36:33.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc4aa67f-8cc3-4d85-9fc4-78de6848675b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59512024-08-28T23:36:33.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc4aa67f-8cc3-4d85-9fc4-78de6848675b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59522024-08-28T23:36:33.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = bc4aa67f-8cc3-4d85-9fc4-78de6848675b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59532024-08-28T23:36:34.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c6f8fa-9cdb-4474-87f8-e89eb03bd52d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59542024-08-28T23:36:34.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c6f8fa-9cdb-4474-87f8-e89eb03bd52d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59552024-08-28T23:36:34.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 16c6f8fa-9cdb-4474-87f8-e89eb03bd52d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59562024-08-28T23:36:35.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ea37d18c-c060-4965-aa65-39768f9c0d4f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59572024-08-28T23:36:35.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ea37d18c-c060-4965-aa65-39768f9c0d4f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59582024-08-28T23:36:35.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ea37d18c-c060-4965-aa65-39768f9c0d4f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59592024-08-28T23:36:36.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd290c0a-2dfb-4203-ba99-22b056f5ee22 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59602024-08-28T23:36:36.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd290c0a-2dfb-4203-ba99-22b056f5ee22 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59612024-08-28T23:36:36.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dd290c0a-2dfb-4203-ba99-22b056f5ee22 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59622024-08-28T23:36:37.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 397b8940-152e-4d40-a42e-2b0e7a8ea0c0 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59632024-08-28T23:36:37.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 397b8940-152e-4d40-a42e-2b0e7a8ea0c0 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59642024-08-28T23:36:37.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 397b8940-152e-4d40-a42e-2b0e7a8ea0c0 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59652024-08-28T23:36:38.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2030f53c-20ea-4449-bd57-fb165e41f921 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59662024-08-28T23:36:38.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2030f53c-20ea-4449-bd57-fb165e41f921 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59672024-08-28T23:36:38.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2030f53c-20ea-4449-bd57-fb165e41f921 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59682024-08-28T23:36:39.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6926b025-201e-4aa3-adfa-f7d954449b5f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59692024-08-28T23:36:39.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6926b025-201e-4aa3-adfa-f7d954449b5f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59702024-08-28T23:36:39.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6926b025-201e-4aa3-adfa-f7d954449b5f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59712024-08-28T23:36:40.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a711bb3d-eb9f-4742-85b4-2e4f299d8348 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59722024-08-28T23:36:40.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a711bb3d-eb9f-4742-85b4-2e4f299d8348 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59732024-08-28T23:36:40.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = a711bb3d-eb9f-4742-85b4-2e4f299d8348 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59742024-08-28T23:36:41.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7abdec4f-c119-486b-a900-0e3f9a7a6142 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59752024-08-28T23:36:41.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7abdec4f-c119-486b-a900-0e3f9a7a6142 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59762024-08-28T23:36:41.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 7abdec4f-c119-486b-a900-0e3f9a7a6142 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59772024-08-28T23:36:42.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
59782024-08-28T23:36:42.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59792024-08-28T23:36:42.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59802024-08-28T23:36:42.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
59812024-08-28T23:36:42.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59822024-08-28T23:36:42.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59832024-08-28T23:36:42.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842024-08-28T23:36:42.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59852024-08-28T23:36:42.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862024-08-28T23:36:42.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872024-08-28T23:36:42.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59882024-08-28T23:36:42.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59892024-08-28T23:36:42.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59902024-08-28T23:36:42.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59912024-08-28T23:36:42.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-08-28T23:36:42.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
59932024-08-28T23:36:42.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59942024-08-28T23:36:42.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59952024-08-28T23:36:42.132ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
59962024-08-28T23:36:42.132ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.82609ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
59972024-08-28T23:36:42.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.966527ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59982024-08-28T23:36:42.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6761d46a-9e0d-43ab-b066-373d3c9c8a9b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
59992024-08-28T23:36:42.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6761d46a-9e0d-43ab-b066-373d3c9c8a9b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60002024-08-28T23:36:42.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6761d46a-9e0d-43ab-b066-373d3c9c8a9b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60012024-08-28T23:36:43.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 467 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = e2556b2e-ecb8-4f4d-b388-8f9f7c41bf75 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
60022024-08-28T23:36:43.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ce7ee4a-6f31-4625-a741-8dbf522bf30b roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60032024-08-28T23:36:43.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ce7ee4a-6f31-4625-a741-8dbf522bf30b resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60042024-08-28T23:36:43.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 6ce7ee4a-6f31-4625-a741-8dbf522bf30b response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60052024-08-28T23:36:44.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0182a7ed-4dd4-43fc-a212-34f111721315 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60062024-08-28T23:36:44.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0182a7ed-4dd4-43fc-a212-34f111721315 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60072024-08-28T23:36:44.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0182a7ed-4dd4-43fc-a212-34f111721315 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60082024-08-28T23:36:45.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0478a6db-d5b2-4447-969e-68835e271c43 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60092024-08-28T23:36:45.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0478a6db-d5b2-4447-969e-68835e271c43 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60102024-08-28T23:36:45.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0478a6db-d5b2-4447-969e-68835e271c43 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60112024-08-28T23:36:47.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9e730cf-844e-4c19-8f67-94088a7a73ab roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60122024-08-28T23:36:47.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9e730cf-844e-4c19-8f67-94088a7a73ab resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60132024-08-28T23:36:47.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9e730cf-844e-4c19-8f67-94088a7a73ab response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60142024-08-28T23:36:48.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4ee27a37-bc20-40fb-9af8-de722a3fc236 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60152024-08-28T23:36:48.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4ee27a37-bc20-40fb-9af8-de722a3fc236 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60162024-08-28T23:36:48.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4ee27a37-bc20-40fb-9af8-de722a3fc236 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60172024-08-28T23:36:49.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4b222aa5-fbc2-443f-9c70-ccbb54c13692 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60182024-08-28T23:36:49.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4b222aa5-fbc2-443f-9c70-ccbb54c13692 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60192024-08-28T23:36:49.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 4b222aa5-fbc2-443f-9c70-ccbb54c13692 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60202024-08-28T23:36:50.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cfa34f4-f763-4114-9ece-d0e68b9bd648 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60212024-08-28T23:36:50.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cfa34f4-f763-4114-9ece-d0e68b9bd648 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60222024-08-28T23:36:50.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 0cfa34f4-f763-4114-9ece-d0e68b9bd648 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60232024-08-28T23:36:51.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2a38aeaf-837b-431e-a06b-fb2f1c7d82a3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60242024-08-28T23:36:51.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2a38aeaf-837b-431e-a06b-fb2f1c7d82a3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60252024-08-28T23:36:51.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 2a38aeaf-837b-431e-a06b-fb2f1c7d82a3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
60262024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
60272024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
60282024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60292024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
60302024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60312024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
60322024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
60332024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
60342024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
60352024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60362024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
60372024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60382024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
60392024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60402024-08-28T23:36:52.089ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85
60412024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
60422024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.2\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85"}
60432024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60442024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
60452024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
60462024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60472024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
60482024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60492024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
60502024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60512024-08-28T23:36:52.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60522024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60532024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60542024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60552024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60562024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60572024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60582024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60592024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60602024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60612024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60622024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60632024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60642024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60652024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60662024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60672024-08-28T23:36:52.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
60682024-08-28T23:36:52.091ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
60692024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60702024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
60712024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60722024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
60732024-08-28T23:36:52.091ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60742024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
60752024-08-28T23:36:52.091ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 23:26:52.091023903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60762024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60772024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60782024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
60792024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60802024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
60812024-08-28T23:36:52.091ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
60822024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60832024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
60842024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60852024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
60862024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60872024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
60882024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60892024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
60902024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60912024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
60922024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60932024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60942024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
60952024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60962024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
60972024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60982024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
60992024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61002024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61012024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
61022024-08-28T23:36:52.091ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("219f2a7b-fe2d-4299-b4e9-e2bd11379c00.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bf9867b8-4340-4b2d-8034-f00632878d92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 872753449 } })
61032024-08-28T23:36:52.091ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("04e0ae3c-05ff-44a5-897c-b194c21afd3b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("709564a5-1a18-452f-91d3-0ee33515b90a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8bc09bd7-8ab0-40ac-ba02-6ff7e3136287.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 872758919 } })
61042024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61052024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61062024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61072024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61082024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61092024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61102024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61112024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61122024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61132024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61142024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61152024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61162024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61172024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61182024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61192024-08-28T23:36:52.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61202024-08-28T23:36:52.093ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
61212024-08-28T23:36:52.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.905991ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
61222024-08-28T23:36:52.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232024-08-28T23:36:52.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61242024-08-28T23:36:52.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61252024-08-28T23:36:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.94537ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61262024-08-28T23:36:52.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61272024-08-28T23:36:52.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 876622940 } })
61282024-08-28T23:36:52.095ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
61292024-08-28T23:36:52.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.607532ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
61302024-08-28T23:36:52.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61312024-08-28T23:36:52.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61322024-08-28T23:36:52.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
61332024-08-28T23:36:52.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342024-08-28T23:36:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61352024-08-28T23:36:52.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61362024-08-28T23:36:52.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 878031255 } })
61372024-08-28T23:36:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61382024-08-28T23:36:52.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
61392024-08-28T23:36:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61402024-08-28T23:36:52.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61412024-08-28T23:36:52.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61422024-08-28T23:36:52.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61432024-08-28T23:36:52.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61442024-08-28T23:36:52.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452024-08-28T23:36:52.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61462024-08-28T23:36:52.102ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 23:26:52.091023903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61472024-08-28T23:36:52.102ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.253085ms iteration = 10 status = {"expiration":"2024-08-28T23:26:52.091023903Z","pruned":[]}
61482024-08-28T23:36:52.102ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61492024-08-28T23:36:52.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61502024-08-28T23:36:52.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61512024-08-28T23:36:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61522024-08-28T23:36:52.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61532024-08-28T23:36:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61542024-08-28T23:36:52.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61552024-08-28T23:36:52.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61562024-08-28T23:36:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61572024-08-28T23:36:52.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61582024-08-28T23:36:52.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61592024-08-28T23:36:52.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61602024-08-28T23:36:52.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61612024-08-28T23:36:52.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61622024-08-28T23:36:52.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61632024-08-28T23:36:52.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642024-08-28T23:36:52.113ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.750864ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
61652024-08-28T23:36:52.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61662024-08-28T23:36:52.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9973be3d-f2f5-4c90-847c-231f1e34497c roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
61672024-08-28T23:36:52.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61682024-08-28T23:36:52.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61692024-08-28T23:36:52.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61702024-08-28T23:36:52.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9973be3d-f2f5-4c90-847c-231f1e34497c resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
61712024-08-28T23:36:52.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61722024-08-28T23:36:52.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61732024-08-28T23:36:52.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61742024-08-28T23:36:52.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61752024-08-28T23:36:52.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61762024-08-28T23:36:52.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61772024-08-28T23:36:52.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61782024-08-28T23:36:52.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61792024-08-28T23:36:52.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61802024-08-28T23:36:52.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61812024-08-28T23:36:52.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61822024-08-28T23:36:52.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 13390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9973be3d-f2f5-4c90-847c-231f1e34497c response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
61832024-08-28T23:36:52.130ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61842024-08-28T23:36:52.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61852024-08-28T23:36:52.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61862024-08-28T23:36:52.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61872024-08-28T23:36:52.135ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 916872343 } })
61882024-08-28T23:36:52.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892024-08-28T23:36:52.137ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
61902024-08-28T23:36:52.137ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61912024-08-28T23:36:52.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61922024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61932024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61942024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61952024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61962024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61972024-08-28T23:36:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61982024-08-28T23:36:52.141ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
61992024-08-28T23:36:52.141ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
62002024-08-28T23:36:52.141ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 50.078003ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
62012024-08-28T23:36:52.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62022024-08-28T23:36:52.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62032024-08-28T23:36:52.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62042024-08-28T23:36:52.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
62052024-08-28T23:36:52.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62062024-08-28T23:36:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62072024-08-28T23:36:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62082024-08-28T23:36:52.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62092024-08-28T23:36:52.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62102024-08-28T23:36:52.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62112024-08-28T23:36:52.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62122024-08-28T23:36:52.151ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 61.563792ms iteration = 5 status = {"nsuccess":5}
62132024-08-28T23:36:52.151ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62142024-08-28T23:36:52.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62152024-08-28T23:36:52.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.57215ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
62162024-08-28T23:36:52.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62172024-08-28T23:36:52.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62182024-08-28T23:36:52.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-08-28T23:36:52.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
62212024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.186162ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
62222024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62232024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62242024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62252024-08-28T23:36:52.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62262024-08-28T23:36:52.158ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
62272024-08-28T23:36:52.159ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62282024-08-28T23:36:52.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62292024-08-28T23:36:52.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62302024-08-28T23:36:52.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62312024-08-28T23:36:52.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62322024-08-28T23:36:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62332024-08-28T23:36:52.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62342024-08-28T23:36:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62352024-08-28T23:36:52.161ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62362024-08-28T23:36:52.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62372024-08-28T23:36:52.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62382024-08-28T23:36:52.162ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62392024-08-28T23:36:52.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62402024-08-28T23:36:52.165ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62412024-08-28T23:36:52.165ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62422024-08-28T23:36:52.165ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.705401ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62432024-08-28T23:36:52.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62442024-08-28T23:36:52.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62452024-08-28T23:36:52.190ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62462024-08-28T23:36:52.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62472024-08-28T23:36:52.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62482024-08-28T23:36:52.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62492024-08-28T23:36:52.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.008627ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62502024-08-28T23:36:52.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62512024-08-28T23:36:52.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
62522024-08-28T23:36:52.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62532024-08-28T23:36:52.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62542024-08-28T23:36:52.200ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.208649ms iteration = 19 status = 0
62552024-08-28T23:36:52.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62562024-08-28T23:36:52.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62572024-08-28T23:36:52.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62582024-08-28T23:36:52.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.807424ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
62592024-08-28T23:36:52.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62602024-08-28T23:36:52.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62612024-08-28T23:36:52.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62622024-08-28T23:36:52.207ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62632024-08-28T23:36:52.207ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62642024-08-28T23:36:52.207ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62652024-08-28T23:36:52.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62662024-08-28T23:36:52.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62672024-08-28T23:36:52.208ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62682024-08-28T23:36:52.208ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62692024-08-28T23:36:52.208ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62702024-08-28T23:36:52.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62712024-08-28T23:36:52.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62722024-08-28T23:36:52.209ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
62732024-08-28T23:36:52.209ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62742024-08-28T23:36:52.209ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.059711ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
62752024-08-28T23:36:52.210ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.058119ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62762024-08-28T23:36:52.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62772024-08-28T23:36:52.214ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62782024-08-28T23:36:52.214ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.547641ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62792024-08-28T23:36:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62802024-08-28T23:36:52.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62812024-08-28T23:36:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62822024-08-28T23:36:52.220ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62832024-08-28T23:36:52.220ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62842024-08-28T23:36:52.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62852024-08-28T23:36:52.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62862024-08-28T23:36:52.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-08-28T23:36:52.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62882024-08-28T23:36:52.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62892024-08-28T23:36:52.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62902024-08-28T23:36:52.232ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
62912024-08-28T23:36:52.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.652291ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62922024-08-28T23:36:52.236ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 25c4e84f-9538-439c-afbc-ec3b05f125ca dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
62932024-08-28T23:36:52.236ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62942024-08-28T23:36:52.236ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 23:27:53.311198 UTC dns_group = internal generation = 1
62952024-08-28T23:36:52.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.072779ms iteration = 10 status = {"generation":1}
62962024-08-28T23:36:52.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62972024-08-28T23:36:52.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62982024-08-28T23:36:52.242ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62992024-08-28T23:36:52.254ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T23:27:50.315705Z, time_modified: 2024-08-28T23:27:50.315705Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, db_silo: Silo { identity: SiloIdentity { id: 7324ef70-30e4-4a3e-b6ee-698ed5a7bd63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T23:27:54.272593Z, time_modified: 2024-08-28T23:27:54.272593Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c" }] }) }
63002024-08-28T23:36:52.254ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.702651ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]}},"default_endpoint":{"silo_id":"7324ef70-30e4-4a3e-b6ee-698ed5a7bd63","tls_certs":["3abddb66cf57f06ae87ca5b23d55611496a81f57b19db695bf811a350280480c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63012024-08-28T23:36:52.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63022024-08-28T23:36:52.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63032024-08-28T23:36:52.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63042024-08-28T23:36:52.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63052024-08-28T23:36:52.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63062024-08-28T23:36:52.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63072024-08-28T23:36:52.270ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63082024-08-28T23:36:52.270ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8cb437a9-b8c8-4bd4-b131-0ee8555a0784", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63092024-08-28T23:36:52.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63102024-08-28T23:36:52.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63112024-08-28T23:36:52.273ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.478523ms iteration = 21 status = {"physical_disks_added":0}
63122024-08-28T23:36:52.273ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63132024-08-28T23:36:52.273ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63142024-08-28T23:36:52.273ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "032fb22b-6f0f-4a70-bc4b-c0e9cc43bada", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63152024-08-28T23:36:52.273ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63162024-08-28T23:36:52.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63172024-08-28T23:36:52.314ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63182024-08-28T23:36:52.314ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 0 version = 2
63192024-08-28T23:36:52.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63202024-08-28T23:36:52.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63212024-08-28T23:36:52.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63222024-08-28T23:36:52.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63232024-08-28T23:36:52.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63242024-08-28T23:36:52.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed42991b-6245-4233-825d-1b5d2225b187", "content-length": "372", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63252024-08-28T23:36:52.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63262024-08-28T23:36:52.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63272024-08-28T23:36:52.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63282024-08-28T23:36:52.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63292024-08-28T23:36:52.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63302024-08-28T23:36:52.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63312024-08-28T23:36:52.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63322024-08-28T23:36:52.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63332024-08-28T23:36:52.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63342024-08-28T23:36:52.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63352024-08-28T23:36:52.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63362024-08-28T23:36:52.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63372024-08-28T23:36:52.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63382024-08-28T23:36:52.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63392024-08-28T23:36:52.421ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63402024-08-28T23:36:52.422ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de0572ce-ba9c-41e6-96bb-fd46f6b37dc2", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63412024-08-28T23:36:52.423ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 332.477117ms iteration = 20 status = {}
63422024-08-28T23:36:52.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63432024-08-28T23:36:52.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63442024-08-28T23:36:52.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63452024-08-28T23:36:52.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63462024-08-28T23:36:52.447ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d4865e86-f563-4eb3-a841-4e4c571cad92 dns_zone_name = oxide.test found_so_far = 1 version = 2
63472024-08-28T23:36:52.447ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63482024-08-28T23:36:52.447ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 23:27:54.335078 UTC dns_group = external generation = 2
63492024-08-28T23:36:52.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 358.117275ms iteration = 10 status = {"generation":2}
63502024-08-28T23:36:52.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
63512024-08-28T23:36:52.524ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63522024-08-28T23:36:52.525ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a6ec5b4-af6a-4758-9184-389b80b20234", "content-length": "26", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63532024-08-28T23:36:52.525ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63542024-08-28T23:36:52.527ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
63552024-08-28T23:36:52.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63562024-08-28T23:36:52.565ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c05526c1-715a-4877-9a38-f1f5846b184c", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63572024-08-28T23:36:52.565ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63582024-08-28T23:36:52.568ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "69349337-bb0c-457d-8965-1fe8b9a5913f", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63592024-08-28T23:36:52.568ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63602024-08-28T23:36:52.569ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63612024-08-28T23:36:52.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 479.904433ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63622024-08-28T23:36:52.576ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.792079ms iteration = 19 status = {}
63632024-08-28T23:36:52.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63642024-08-28T23:36:52.603ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63652024-08-28T23:36:52.604ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9847bae2-510c-4b9b-9d24-1b2fff6c2541", "content-length": "2", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63662024-08-28T23:36:52.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63672024-08-28T23:36:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63682024-08-28T23:36:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.370524ms iteration = 19 status = null
63692024-08-28T23:36:52.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63702024-08-28T23:36:52.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3542dd3d-f151-46a5-aabf-ee4542ae5ed7", "content-length": "691", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63712024-08-28T23:36:52.613ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63722024-08-28T23:36:52.613ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63732024-08-28T23:36:52.613ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63742024-08-28T23:36:52.615ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.092448ms iteration = 20 status = {}
63752024-08-28T23:36:52.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63762024-08-28T23:36:52.673ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b61a3e68-3f32-4e29-8152-19f46e7fbf5f", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63772024-08-28T23:36:52.673ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63782024-08-28T23:36:52.675ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8dc3e191-5ded-4b9f-805a-d82b88642e9f", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63792024-08-28T23:36:52.675ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63802024-08-28T23:36:52.677ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "75e5c0ab-8aa3-4613-b943-4b8b0ef03440", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63812024-08-28T23:36:52.677ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63822024-08-28T23:36:52.679ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63832024-08-28T23:36:52.680ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 590.317905ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63842024-08-28T23:36:52.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63852024-08-28T23:36:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63862024-08-28T23:36:52.718ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
63872024-08-28T23:36:52.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63882024-08-28T23:36:52.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63892024-08-28T23:36:52.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63902024-08-28T23:36:52.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75c126a5-d618-4c95-bb2d-570c3713e4ba", "content-length": "121", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
63912024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63922024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
63932024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63942024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63952024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
63962024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
63972024-08-28T23:36:52.728ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
63982024-08-28T23:36:52.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63992024-08-28T23:36:52.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64002024-08-28T23:36:52.731ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64012024-08-28T23:36:52.731ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ce49e6d-1691-48fd-b218-4ecf9323847b", "content-length": "2", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
64022024-08-28T23:36:52.731ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64032024-08-28T23:36:52.731ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b78376c-49d7-4502-a7a3-7e6e19250de5", "content-length": "52", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
64042024-08-28T23:36:52.731ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
64052024-08-28T23:36:52.731ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64062024-08-28T23:36:52.824ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "387a09be-4427-4d15-a6cb-cf4268635fca", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
64072024-08-28T23:36:52.824ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
64082024-08-28T23:36:52.824ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64092024-08-28T23:36:52.824ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "111e0ca6-a03f-4467-aeb0-7c01374d1b54", "content-length": "667", "date": "Wed, 28 Aug 2024 23:36:52 GMT"} })
64102024-08-28T23:36:52.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64112024-08-28T23:36:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64122024-08-28T23:36:52.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64132024-08-28T23:36:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64142024-08-28T23:36:52.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64152024-08-28T23:36:52.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64162024-08-28T23:36:52.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64172024-08-28T23:36:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64182024-08-28T23:36:52.841ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 750.086006ms iteration = 19 status = {}
64192024-08-28T23:36:53.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 93c2dcd5-950a-4ebe-88ef-c3fafbacb2c2 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
64202024-08-28T23:36:53.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67ce45e2-a745-4c7d-8efc-cbd288545344 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64212024-08-28T23:36:53.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67ce45e2-a745-4c7d-8efc-cbd288545344 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64222024-08-28T23:36:53.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 67ce45e2-a745-4c7d-8efc-cbd288545344 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64232024-08-28T23:36:54.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b236e53d-9eed-4879-822f-b9923fb8625f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64242024-08-28T23:36:54.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b236e53d-9eed-4879-822f-b9923fb8625f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64252024-08-28T23:36:54.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b236e53d-9eed-4879-822f-b9923fb8625f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64262024-08-28T23:36:55.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e13d4bad-007d-41c1-86db-a50014423f4f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64272024-08-28T23:36:55.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e13d4bad-007d-41c1-86db-a50014423f4f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64282024-08-28T23:36:55.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e13d4bad-007d-41c1-86db-a50014423f4f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64292024-08-28T23:36:56.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29d066cc-1076-4207-9e2a-746f26c1f94e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64302024-08-28T23:36:56.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29d066cc-1076-4207-9e2a-746f26c1f94e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64312024-08-28T23:36:56.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 29d066cc-1076-4207-9e2a-746f26c1f94e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64322024-08-28T23:36:57.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9a983c6-e18f-4d17-b89c-4e235fed2383 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64332024-08-28T23:36:57.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9a983c6-e18f-4d17-b89c-4e235fed2383 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64342024-08-28T23:36:57.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = f9a983c6-e18f-4d17-b89c-4e235fed2383 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64352024-08-28T23:36:58.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 206d48bf-8015-463e-bbfa-d2db31264548 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64362024-08-28T23:36:58.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 206d48bf-8015-463e-bbfa-d2db31264548 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64372024-08-28T23:36:58.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 206d48bf-8015-463e-bbfa-d2db31264548 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64382024-08-28T23:36:59.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9a23562b-0cfd-447d-9c21-fe1a7fb58000 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64392024-08-28T23:36:59.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9a23562b-0cfd-447d-9c21-fe1a7fb58000 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64402024-08-28T23:36:59.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9a23562b-0cfd-447d-9c21-fe1a7fb58000 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64412024-08-28T23:37:00.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 37b34520-e6f9-48dd-b0d0-b539d2294677 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64422024-08-28T23:37:00.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 37b34520-e6f9-48dd-b0d0-b539d2294677 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64432024-08-28T23:37:00.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 37b34520-e6f9-48dd-b0d0-b539d2294677 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64442024-08-28T23:37:01.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dff884f1-7079-4251-8c18-7e62b6aa8532 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64452024-08-28T23:37:01.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dff884f1-7079-4251-8c18-7e62b6aa8532 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64462024-08-28T23:37:01.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = dff884f1-7079-4251-8c18-7e62b6aa8532 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64472024-08-28T23:37:02.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
64482024-08-28T23:37:02.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64492024-08-28T23:37:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64502024-08-28T23:37:02.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
64512024-08-28T23:37:02.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64522024-08-28T23:37:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64532024-08-28T23:37:02.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542024-08-28T23:37:02.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64552024-08-28T23:37:02.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64562024-08-28T23:37:02.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.49013ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64572024-08-28T23:37:02.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64582024-08-28T23:37:02.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64592024-08-28T23:37:02.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64602024-08-28T23:37:02.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612024-08-28T23:37:02.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64622024-08-28T23:37:02.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64632024-08-28T23:37:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
64642024-08-28T23:37:02.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64652024-08-28T23:37:02.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64662024-08-28T23:37:02.132ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
64672024-08-28T23:37:02.132ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.412462ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
64682024-08-28T23:37:02.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74476a51-adfa-46ff-bf76-eab0543bab9d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64692024-08-28T23:37:02.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74476a51-adfa-46ff-bf76-eab0543bab9d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64702024-08-28T23:37:02.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 74476a51-adfa-46ff-bf76-eab0543bab9d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64712024-08-28T23:37:03.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 915 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 12020edf-ccc0-47a3-be51-49f414bdd252 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
64722024-08-28T23:37:03.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8bea1b2e-64fa-4a5e-be73-873297c0fcc9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64732024-08-28T23:37:03.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8bea1b2e-64fa-4a5e-be73-873297c0fcc9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64742024-08-28T23:37:03.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8bea1b2e-64fa-4a5e-be73-873297c0fcc9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64752024-08-28T23:37:04.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198094ef-3b41-4e85-b00a-4ba450819fc2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64762024-08-28T23:37:04.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198094ef-3b41-4e85-b00a-4ba450819fc2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64772024-08-28T23:37:04.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 198094ef-3b41-4e85-b00a-4ba450819fc2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64782024-08-28T23:37:05.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 31b10fb2-a83c-4308-a813-1921a92d2508 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64792024-08-28T23:37:05.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 31b10fb2-a83c-4308-a813-1921a92d2508 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64802024-08-28T23:37:05.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 31b10fb2-a83c-4308-a813-1921a92d2508 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64812024-08-28T23:37:06.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 703000cd-6e1c-4d56-bf16-285391788cc2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64822024-08-28T23:37:06.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 703000cd-6e1c-4d56-bf16-285391788cc2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64832024-08-28T23:37:06.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 703000cd-6e1c-4d56-bf16-285391788cc2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64842024-08-28T23:37:07.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5f5912-716d-4332-9adb-09663f47d483 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64852024-08-28T23:37:07.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5f5912-716d-4332-9adb-09663f47d483 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64862024-08-28T23:37:07.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 5b5f5912-716d-4332-9adb-09663f47d483 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64872024-08-28T23:37:08.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 033b0519-a4dd-4141-a186-61839a64dc28 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64882024-08-28T23:37:08.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 033b0519-a4dd-4141-a186-61839a64dc28 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64892024-08-28T23:37:08.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 033b0519-a4dd-4141-a186-61839a64dc28 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64902024-08-28T23:37:09.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bd394ab-5c66-4261-b2ec-2b68e04170c8 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64912024-08-28T23:37:09.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bd394ab-5c66-4261-b2ec-2b68e04170c8 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64922024-08-28T23:37:09.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3bd394ab-5c66-4261-b2ec-2b68e04170c8 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64932024-08-28T23:37:10.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e72f1076-aa78-4d9d-bf9f-4191aca3c030 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64942024-08-28T23:37:10.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e72f1076-aa78-4d9d-bf9f-4191aca3c030 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64952024-08-28T23:37:10.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e72f1076-aa78-4d9d-bf9f-4191aca3c030 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64962024-08-28T23:37:11.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = df0d25d2-146b-4798-8033-88828010b77e roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64972024-08-28T23:37:11.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = df0d25d2-146b-4798-8033-88828010b77e resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64982024-08-28T23:37:11.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = df0d25d2-146b-4798-8033-88828010b77e response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
64992024-08-28T23:37:12.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
65002024-08-28T23:37:12.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65012024-08-28T23:37:12.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65022024-08-28T23:37:12.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
65032024-08-28T23:37:12.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65042024-08-28T23:37:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65052024-08-28T23:37:12.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062024-08-28T23:37:12.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65072024-08-28T23:37:12.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65082024-08-28T23:37:12.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.935863ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65092024-08-28T23:37:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65102024-08-28T23:37:12.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65112024-08-28T23:37:12.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65122024-08-28T23:37:12.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65132024-08-28T23:37:12.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65142024-08-28T23:37:12.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65152024-08-28T23:37:12.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
65162024-08-28T23:37:12.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65172024-08-28T23:37:12.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65182024-08-28T23:37:12.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
65192024-08-28T23:37:12.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.902336ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
65202024-08-28T23:37:12.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e783a90e-b2c4-46aa-a029-4c396aece271 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65212024-08-28T23:37:12.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e783a90e-b2c4-46aa-a029-4c396aece271 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65222024-08-28T23:37:12.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = e783a90e-b2c4-46aa-a029-4c396aece271 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65232024-08-28T23:37:13.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 798 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 2966bada-e469-4b1e-aa21-243cf186d956 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
65242024-08-28T23:37:13.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b94fcc41-4186-481e-8820-51adb6556ae1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65252024-08-28T23:37:13.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b94fcc41-4186-481e-8820-51adb6556ae1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65262024-08-28T23:37:13.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = b94fcc41-4186-481e-8820-51adb6556ae1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65272024-08-28T23:37:14.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 183e783f-5f66-4eb9-a0d2-a01ac14012fb roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65282024-08-28T23:37:14.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 183e783f-5f66-4eb9-a0d2-a01ac14012fb resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65292024-08-28T23:37:14.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 183e783f-5f66-4eb9-a0d2-a01ac14012fb response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65302024-08-28T23:37:15.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ba6f843f-97f0-4210-8ccd-9e867363f431 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65312024-08-28T23:37:15.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ba6f843f-97f0-4210-8ccd-9e867363f431 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65322024-08-28T23:37:15.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ba6f843f-97f0-4210-8ccd-9e867363f431 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65332024-08-28T23:37:16.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3306e604-8312-47f9-bffe-865791caad29 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65342024-08-28T23:37:16.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3306e604-8312-47f9-bffe-865791caad29 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65352024-08-28T23:37:16.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3306e604-8312-47f9-bffe-865791caad29 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65362024-08-28T23:37:17.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99b9d76d-26eb-410a-b4d1-b6cdb33df930 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65372024-08-28T23:37:17.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99b9d76d-26eb-410a-b4d1-b6cdb33df930 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65382024-08-28T23:37:17.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 99b9d76d-26eb-410a-b4d1-b6cdb33df930 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65392024-08-28T23:37:18.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97b06b4e-71da-4528-b282-5442f824f236 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65402024-08-28T23:37:18.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97b06b4e-71da-4528-b282-5442f824f236 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65412024-08-28T23:37:18.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 97b06b4e-71da-4528-b282-5442f824f236 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65422024-08-28T23:37:19.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50e68fa9-dc97-47c5-96f3-e1f23f20c1c1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65432024-08-28T23:37:19.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50e68fa9-dc97-47c5-96f3-e1f23f20c1c1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65442024-08-28T23:37:19.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 50e68fa9-dc97-47c5-96f3-e1f23f20c1c1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65452024-08-28T23:37:20.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d70acfbc-c8e2-414f-85ef-9dce0689e385 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65462024-08-28T23:37:20.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d70acfbc-c8e2-414f-85ef-9dce0689e385 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65472024-08-28T23:37:20.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = d70acfbc-c8e2-414f-85ef-9dce0689e385 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65482024-08-28T23:37:21.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c142565c-dc85-4056-b8aa-136d86446c58 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65492024-08-28T23:37:21.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c142565c-dc85-4056-b8aa-136d86446c58 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65502024-08-28T23:37:21.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = c142565c-dc85-4056-b8aa-136d86446c58 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
65512024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
65522024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
65532024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65542024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
65552024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
65562024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65572024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
65582024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65592024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65602024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65612024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65622024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65632024-08-28T23:37:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65642024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
65652024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
65662024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65672024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65682024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65692024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
65702024-08-28T23:37:22.090ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
65712024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65722024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
65732024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
65742024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65752024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65762024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
65772024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65782024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
65792024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65802024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
65812024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65822024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
65832024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65842024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
65852024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65862024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
65872024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65882024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65892024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65902024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65912024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65922024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65932024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65942024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65952024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65962024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65972024-08-28T23:37:22.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65982024-08-28T23:37:22.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65992024-08-28T23:37:22.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66002024-08-28T23:37:22.092ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.408522ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66012024-08-28T23:37:22.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-08-28T23:37:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 874979180 } })
66032024-08-28T23:37:22.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 875049101 } })
66042024-08-28T23:37:22.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66052024-08-28T23:37:22.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
66062024-08-28T23:37:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66072024-08-28T23:37:22.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66082024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66092024-08-28T23:37:22.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
66102024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66112024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66122024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66132024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66142024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66152024-08-28T23:37:22.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66162024-08-28T23:37:22.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172024-08-28T23:37:22.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182024-08-28T23:37:22.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192024-08-28T23:37:22.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66202024-08-28T23:37:22.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66212024-08-28T23:37:22.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66222024-08-28T23:37:22.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66232024-08-28T23:37:22.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66242024-08-28T23:37:22.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66252024-08-28T23:37:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66262024-08-28T23:37:22.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66272024-08-28T23:37:22.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66282024-08-28T23:37:22.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66292024-08-28T23:37:22.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66302024-08-28T23:37:22.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66312024-08-28T23:37:22.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66322024-08-28T23:37:22.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-5e183b09-4b6e-4bbe-a12c-39af1cbe2a76.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 890894150 } })
66332024-08-28T23:37:22.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66342024-08-28T23:37:22.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
66352024-08-28T23:37:22.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-08-28T23:37:22.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66372024-08-28T23:37:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66382024-08-28T23:37:22.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66392024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
66402024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66412024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66422024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66432024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66442024-08-28T23:37:22.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66452024-08-28T23:37:22.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66462024-08-28T23:37:22.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66472024-08-28T23:37:22.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66482024-08-28T23:37:22.131ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
66492024-08-28T23:37:22.131ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66502024-08-28T23:37:22.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66512024-08-28T23:37:22.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66522024-08-28T23:37:22.133ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
66532024-08-28T23:37:22.133ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.87389ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
66542024-08-28T23:37:22.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66552024-08-28T23:37:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66562024-08-28T23:37:22.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66572024-08-28T23:37:22.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66582024-08-28T23:37:22.142ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66592024-08-28T23:37:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66602024-08-28T23:37:22.143ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66612024-08-28T23:37:22.143ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66622024-08-28T23:37:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66632024-08-28T23:37:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66642024-08-28T23:37:22.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.460352ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
66652024-08-28T23:37:22.165ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
66662024-08-28T23:37:22.165ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66672024-08-28T23:37:22.165ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.056958ms iteration = 20 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
66682024-08-28T23:37:22.180ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66692024-08-28T23:37:22.180ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.339546ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66702024-08-28T23:37:22.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66712024-08-28T23:37:22.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66722024-08-28T23:37:22.250ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.714939ms iteration = 22 status = {"physical_disks_added":0}
66732024-08-28T23:37:22.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b zone_address = fd00:1122:3344:101::2
66742024-08-28T23:37:22.256ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66752024-08-28T23:37:22.257ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3601acdd-c799-4ae6-b99c-8da26d923e6b", "content-length": "26", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
66762024-08-28T23:37:22.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66772024-08-28T23:37:22.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
66782024-08-28T23:37:22.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66792024-08-28T23:37:22.279ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26700de4-ac64-462a-9489-795594979b07", "content-length": "372", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
66802024-08-28T23:37:22.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66812024-08-28T23:37:22.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66822024-08-28T23:37:22.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 191.363867ms iteration = 20 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
66832024-08-28T23:37:22.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 191.528649ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66842024-08-28T23:37:22.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66852024-08-28T23:37:22.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66862024-08-28T23:37:22.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-08-28T23:37:22.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66882024-08-28T23:37:22.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66892024-08-28T23:37:22.286ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
66902024-08-28T23:37:22.286ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66912024-08-28T23:37:22.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76, lookup_type: ById(5e183b09-4b6e-4bbe-a12c-39af1cbe2a76) } result = Ok(())
66922024-08-28T23:37:22.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66932024-08-28T23:37:22.286ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32c84049-a8a7-4132-abc9-14b27ccdd098", "content-length": "26", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
66942024-08-28T23:37:22.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66952024-08-28T23:37:22.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66962024-08-28T23:37:22.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66972024-08-28T23:37:22.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66982024-08-28T23:37:22.288ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 198.049738ms iteration = 20 status = 0
66992024-08-28T23:37:22.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67002024-08-28T23:37:22.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67012024-08-28T23:37:22.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67022024-08-28T23:37:22.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67032024-08-28T23:37:22.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-08-28T23:37:22.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67052024-08-28T23:37:22.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67062024-08-28T23:37:22.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67072024-08-28T23:37:22.298ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67082024-08-28T23:37:22.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67092024-08-28T23:37:22.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67102024-08-28T23:37:22.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67112024-08-28T23:37:22.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 228.973502ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67122024-08-28T23:37:22.321ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67132024-08-28T23:37:22.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67142024-08-28T23:37:22.334ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
67152024-08-28T23:37:22.334ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67162024-08-28T23:37:22.335ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb098be0-da3c-468d-b3be-852ab0fa88a5", "content-length": "26", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67172024-08-28T23:37:22.335ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67182024-08-28T23:37:22.337ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67192024-08-28T23:37:22.350ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
67202024-08-28T23:37:22.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 259.840474ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67212024-08-28T23:37:22.401ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bc979174-334b-4364-8af0-e1260fa5cefd", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67222024-08-28T23:37:22.403ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.043933ms iteration = 21 status = {}
67232024-08-28T23:37:22.425ZDEBGnexus (BackgroundTasks): client request SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67242024-08-28T23:37:22.425ZDEBGnexus (BackgroundTasks): client response SledAgent = 5e183b09-4b6e-4bbe-a12c-39af1cbe2a76 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49d7908e-f279-40d2-97f6-bc907ade43d0", "content-length": "691", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67252024-08-28T23:37:22.425ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67262024-08-28T23:37:22.425ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67272024-08-28T23:37:22.425ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67282024-08-28T23:37:22.426ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67292024-08-28T23:37:22.426ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ef16b40-67ca-4e10-bfa6-d2cac55d1d06", "content-length": "2", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67302024-08-28T23:37:22.427ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 336.890978ms iteration = 21 status = {}
67312024-08-28T23:37:22.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67322024-08-28T23:37:22.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67332024-08-28T23:37:22.430ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.605216ms iteration = 20 status = null
67342024-08-28T23:37:22.515ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.347897ms iteration = 20 status = {}
67352024-08-28T23:37:22.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67362024-08-28T23:37:22.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67372024-08-28T23:37:22.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27a8abac-7362-4a4f-9b1d-f75dfbc766dc, rack_id: aedeeb24-20fa-4842-9e3b-369f59cd608b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(38d3bce0-c7b7-4423-b60f-ac58c1b6230a) } rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
67382024-08-28T23:37:22.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67392024-08-28T23:37:22.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67402024-08-28T23:37:22.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67412024-08-28T23:37:22.561ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2044fdc5-3c45-40d4-a24e-77ac2c799ea2", "content-length": "121", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67422024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
67432024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 38d3bce0-c7b7-4423-b60f-ac58c1b6230a
67442024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67452024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67462024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
67472024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b routes = {}
67482024-08-28T23:37:22.561ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b
67492024-08-28T23:37:22.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67502024-08-28T23:37:22.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67512024-08-28T23:37:22.563ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67522024-08-28T23:37:22.563ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71f03659-b3e4-45ef-aeb3-99e3a2620aa6", "content-length": "2", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67532024-08-28T23:37:22.563ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67542024-08-28T23:37:22.563ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6820db-dd79-4441-a202-a2cdfccd8cc5", "content-length": "52", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67552024-08-28T23:37:22.563ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch_location = Switch0
67562024-08-28T23:37:22.563ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67572024-08-28T23:37:22.747ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80eb3a23-1cbf-4ea6-9551-2fc3292bd4eb", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67582024-08-28T23:37:22.747ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b switch = Switch0
67592024-08-28T23:37:22.747ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67602024-08-28T23:37:22.747ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = aedeeb24-20fa-4842-9e3b-369f59cd608b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a17c79b6-911d-4719-ae36-7de67db989c6", "content-length": "667", "date": "Wed, 28 Aug 2024 23:37:22 GMT"} })
67612024-08-28T23:37:22.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67622024-08-28T23:37:22.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67632024-08-28T23:37:22.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67642024-08-28T23:37:22.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67652024-08-28T23:37:22.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67662024-08-28T23:37:22.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67672024-08-28T23:37:22.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67682024-08-28T23:37:22.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67692024-08-28T23:37:22.761ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.054076ms iteration = 20 status = {}
67702024-08-28T23:37:22.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 802e6c0a-856c-4b8f-8ecc-cf4a1d17ae54 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67712024-08-28T23:37:22.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 802e6c0a-856c-4b8f-8ecc-cf4a1d17ae54 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67722024-08-28T23:37:22.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 802e6c0a-856c-4b8f-8ecc-cf4a1d17ae54 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67732024-08-28T23:37:23.028ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 474 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = c9903a13-fa88-499b-a74d-a493fa92bb37 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
67742024-08-28T23:37:23.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaee63a4-373e-4710-a439-73adcdcf0717 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67752024-08-28T23:37:23.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaee63a4-373e-4710-a439-73adcdcf0717 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67762024-08-28T23:37:23.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = aaee63a4-373e-4710-a439-73adcdcf0717 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67772024-08-28T23:37:24.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10934c91-6e7c-41e2-a5d4-65ea8f301bb2 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67782024-08-28T23:37:24.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10934c91-6e7c-41e2-a5d4-65ea8f301bb2 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67792024-08-28T23:37:24.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 10934c91-6e7c-41e2-a5d4-65ea8f301bb2 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67802024-08-28T23:37:25.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 15f1d7ce-71fe-495b-aa5a-c72e39f01227 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67812024-08-28T23:37:25.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 15f1d7ce-71fe-495b-aa5a-c72e39f01227 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67822024-08-28T23:37:25.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 15f1d7ce-71fe-495b-aa5a-c72e39f01227 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67832024-08-28T23:37:26.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 290b5fd8-3c79-443c-814c-dba830fb0f85 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67842024-08-28T23:37:26.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 290b5fd8-3c79-443c-814c-dba830fb0f85 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67852024-08-28T23:37:26.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 290b5fd8-3c79-443c-814c-dba830fb0f85 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67862024-08-28T23:37:27.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 815633c7-2429-4e43-969f-82b1d30b1cd6 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67872024-08-28T23:37:27.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 815633c7-2429-4e43-969f-82b1d30b1cd6 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67882024-08-28T23:37:27.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 815633c7-2429-4e43-969f-82b1d30b1cd6 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67892024-08-28T23:37:28.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ca7b971c-3b48-45af-8f4b-210b1825f8c3 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67902024-08-28T23:37:28.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ca7b971c-3b48-45af-8f4b-210b1825f8c3 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67912024-08-28T23:37:28.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ca7b971c-3b48-45af-8f4b-210b1825f8c3 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67922024-08-28T23:37:29.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43489253-2714-4c97-8e99-1377aaabf4f1 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67932024-08-28T23:37:29.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43489253-2714-4c97-8e99-1377aaabf4f1 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67942024-08-28T23:37:29.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 43489253-2714-4c97-8e99-1377aaabf4f1 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67952024-08-28T23:37:30.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eabd9b21-3a6b-43d4-a5bd-99d5f67fef0f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67962024-08-28T23:37:30.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eabd9b21-3a6b-43d4-a5bd-99d5f67fef0f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67972024-08-28T23:37:30.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = eabd9b21-3a6b-43d4-a5bd-99d5f67fef0f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67982024-08-28T23:37:31.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 45201793-d8af-468c-b51c-24be54a6a07d roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
67992024-08-28T23:37:31.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 45201793-d8af-468c-b51c-24be54a6a07d resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68002024-08-28T23:37:31.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 45201793-d8af-468c-b51c-24be54a6a07d response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68012024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
68022024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68032024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68042024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
68052024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68062024-08-28T23:37:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68072024-08-28T23:37:32.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082024-08-28T23:37:32.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68092024-08-28T23:37:32.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68102024-08-28T23:37:32.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.660306ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68112024-08-28T23:37:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68122024-08-28T23:37:32.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68132024-08-28T23:37:32.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68142024-08-28T23:37:32.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68152024-08-28T23:37:32.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68162024-08-28T23:37:32.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68172024-08-28T23:37:32.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b140d8c2-a699-41fb-98f2-45d9c85d1e85, lookup_type: ById(b140d8c2-a699-41fb-98f2-45d9c85d1e85) } result = Ok(())
68182024-08-28T23:37:32.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68192024-08-28T23:37:32.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68202024-08-28T23:37:32.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 original_time_created = 2024-08-28 23:27:38.644481 UTC target_id = b140d8c2-a699-41fb-98f2-45d9c85d1e85 time_created = 2024-08-28 23:27:38.644481 UTC
68212024-08-28T23:37:32.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.281139ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b140d8c2-a699-41fb-98f2-45d9c85d1e85","time_created":"2024-08-28T23:27:38.644481Z"}
68222024-08-28T23:37:33.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 20b292e2-c736-4fc3-8692-6d32c3879375 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68232024-08-28T23:37:33.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 20b292e2-c736-4fc3-8692-6d32c3879375 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68242024-08-28T23:37:33.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 20b292e2-c736-4fc3-8692-6d32c3879375 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68252024-08-28T23:37:33.029ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 905 local_addr = [fd00:1122:3344:101::c]:41158 method = GET remote_addr = [fd00:1122:3344:101::d]:54863 req_id = 50a962e6-2a5a-4ca1-b45f-b5cb9319ba08 response_code = 200 uri = /424187fd-4660-4136-ae99-d26e8a3dc7ec
68262024-08-28T23:37:34.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ee6facf-5eef-4197-b358-2f42e6830eeb roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68272024-08-28T23:37:34.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ee6facf-5eef-4197-b358-2f42e6830eeb resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68282024-08-28T23:37:34.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3ee6facf-5eef-4197-b358-2f42e6830eeb response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68292024-08-28T23:37:35.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9f786848-9443-4467-adb0-5c9b85c4c84f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68302024-08-28T23:37:35.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9f786848-9443-4467-adb0-5c9b85c4c84f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68312024-08-28T23:37:35.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 9f786848-9443-4467-adb0-5c9b85c4c84f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68322024-08-28T23:37:36.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8451db82-43f0-4c7e-b179-308b8ad5caf9 roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68332024-08-28T23:37:36.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8451db82-43f0-4c7e-b179-308b8ad5caf9 resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68342024-08-28T23:37:36.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 8451db82-43f0-4c7e-b179-308b8ad5caf9 response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68352024-08-28T23:37:37.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3d305ae3-14b6-4587-bfe7-ac1da0cf7a1f roles = RoleSet { roles: {} } uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68362024-08-28T23:37:37.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3d305ae3-14b6-4587-bfe7-ac1da0cf7a1f resource = Database result = Ok(()) uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76
68372024-08-28T23:37:37.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = 3d305ae3-14b6-4587-bfe7-ac1da0cf7a1f response_code = 200 uri = /probes/5e183b09-4b6e-4bbe-a12c-39af1cbe2a76