Max level shown:
12024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
22024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
32024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62024-11-08T01:30:01.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72024-11-08T01:30:01.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82024-11-08T01:30:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92024-11-08T01:30:01.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102024-11-08T01:30:01.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.630978ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112024-11-08T01:30:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122024-11-08T01:30:01.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132024-11-08T01:30:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142024-11-08T01:30:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152024-11-08T01:30:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162024-11-08T01:30:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
172024-11-08T01:30:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
182024-11-08T01:30:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192024-11-08T01:30:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202024-11-08T01:30:01.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
212024-11-08T01:30:01.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.428235ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
222024-11-08T01:30:01.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a1883e75-57b5-41a4-bd20-94f4f602a8c8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
232024-11-08T01:30:01.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a1883e75-57b5-41a4-bd20-94f4f602a8c8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
242024-11-08T01:30:01.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a1883e75-57b5-41a4-bd20-94f4f602a8c8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
252024-11-08T01:30:02.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2eddd8cc-a6f4-4515-ba5f-681f0e88d19f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
262024-11-08T01:30:02.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2eddd8cc-a6f4-4515-ba5f-681f0e88d19f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
272024-11-08T01:30:02.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2eddd8cc-a6f4-4515-ba5f-681f0e88d19f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
282024-11-08T01:30:03.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28adf435-e182-47fe-81ec-ebb7fce45ebb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
292024-11-08T01:30:03.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28adf435-e182-47fe-81ec-ebb7fce45ebb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
302024-11-08T01:30:03.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28adf435-e182-47fe-81ec-ebb7fce45ebb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
312024-11-08T01:30:04.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0120ff11-aa6b-4db9-8af6-342a8280c62c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
322024-11-08T01:30:04.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0120ff11-aa6b-4db9-8af6-342a8280c62c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
332024-11-08T01:30:04.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0120ff11-aa6b-4db9-8af6-342a8280c62c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
342024-11-08T01:30:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6ec28dca-ce83-40f9-84b7-5956a7377cac roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
352024-11-08T01:30:05.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6ec28dca-ce83-40f9-84b7-5956a7377cac resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
362024-11-08T01:30:05.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6ec28dca-ce83-40f9-84b7-5956a7377cac response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
372024-11-08T01:30:05.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7f9839dd-1890-4949-a2ce-c2a2784893bb roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
382024-11-08T01:30:05.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7f9839dd-1890-4949-a2ce-c2a2784893bb resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
392024-11-08T01:30:05.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7f9839dd-1890-4949-a2ce-c2a2784893bb response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
402024-11-08T01:30:05.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c50f65d7-4ec8-4ccf-944c-3af5fa6d060d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
412024-11-08T01:30:05.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c50f65d7-4ec8-4ccf-944c-3af5fa6d060d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
422024-11-08T01:30:05.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c50f65d7-4ec8-4ccf-944c-3af5fa6d060d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
432024-11-08T01:30:06.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2f30cac8-6d38-47aa-96b2-4aa61be9eead roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
442024-11-08T01:30:06.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2f30cac8-6d38-47aa-96b2-4aa61be9eead resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
452024-11-08T01:30:06.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2f30cac8-6d38-47aa-96b2-4aa61be9eead response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
462024-11-08T01:30:07.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d09979fe-e067-4a5f-a1bd-a8dcb46aaefa roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
472024-11-08T01:30:07.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d09979fe-e067-4a5f-a1bd-a8dcb46aaefa resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
482024-11-08T01:30:07.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d09979fe-e067-4a5f-a1bd-a8dcb46aaefa response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
492024-11-08T01:30:08.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abb439d0-0e8a-4b58-b4d9-dfa80a832d9a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
502024-11-08T01:30:08.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abb439d0-0e8a-4b58-b4d9-dfa80a832d9a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
512024-11-08T01:30:08.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abb439d0-0e8a-4b58-b4d9-dfa80a832d9a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
522024-11-08T01:30:09.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9a5da29-f6b9-4b5a-83aa-b9b6d7f5936d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
532024-11-08T01:30:09.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9a5da29-f6b9-4b5a-83aa-b9b6d7f5936d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
542024-11-08T01:30:09.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9a5da29-f6b9-4b5a-83aa-b9b6d7f5936d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
552024-11-08T01:30:10.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9804861e-a7de-472d-9ac6-d0f942318fac roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
562024-11-08T01:30:10.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9804861e-a7de-472d-9ac6-d0f942318fac resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
572024-11-08T01:30:10.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9804861e-a7de-472d-9ac6-d0f942318fac response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
582024-11-08T01:30:11.272ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
592024-11-08T01:30:11.272ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
602024-11-08T01:30:11.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
612024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
622024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.31\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
632024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
642024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
652024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
662024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
672024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
682024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
692024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
702024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.95\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
712024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
722024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
732024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
742024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
752024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.03\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
762024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
772024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.06\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
782024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
792024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
802024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
812024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
822024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
832024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
842024-11-08T01:30:11.273ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
852024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
862024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
872024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
882024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
892024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
902024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
912024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
922024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
942024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
952024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
962024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
972024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
982024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
992024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1002024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1012024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1022024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1032024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1042024-11-08T01:30:11.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1052024-11-08T01:30:11.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1062024-11-08T01:30:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1072024-11-08T01:30:11.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1082024-11-08T01:30:11.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1092024-11-08T01:30:11.276ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.705669ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1102024-11-08T01:30:11.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1112024-11-08T01:30:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1122024-11-08T01:30:11.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1132024-11-08T01:30:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1142024-11-08T01:30:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1152024-11-08T01:30:11.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1162024-11-08T01:30:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1172024-11-08T01:30:11.280ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 492177257 } })
1182024-11-08T01:30:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1192024-11-08T01:30:11.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1202024-11-08T01:30:11.280ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1212024-11-08T01:30:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1222024-11-08T01:30:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1242024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1252024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1262024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1272024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1282024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1292024-11-08T01:30:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1302024-11-08T01:30:11.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 498486132 } })
1312024-11-08T01:30:11.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
1322024-11-08T01:30:11.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 499047250 } })
1332024-11-08T01:30:11.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
1342024-11-08T01:30:11.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1352024-11-08T01:30:11.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1362024-11-08T01:30:11.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1372024-11-08T01:30:11.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1382024-11-08T01:30:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1392024-11-08T01:30:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1402024-11-08T01:30:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1412024-11-08T01:30:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
1422024-11-08T01:30:11.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1432024-11-08T01:30:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1442024-11-08T01:30:11.315ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
1452024-11-08T01:30:11.315ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.725655ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
1462024-11-08T01:30:11.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1472024-11-08T01:30:11.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1482024-11-08T01:30:11.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1492024-11-08T01:30:11.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1502024-11-08T01:30:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1512024-11-08T01:30:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1522024-11-08T01:30:11.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1532024-11-08T01:30:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1542024-11-08T01:30:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1552024-11-08T01:30:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1562024-11-08T01:30:11.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1572024-11-08T01:30:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1582024-11-08T01:30:11.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.576377ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1592024-11-08T01:30:11.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.79241ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1602024-11-08T01:30:11.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1612024-11-08T01:30:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1622024-11-08T01:30:11.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1632024-11-08T01:30:11.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1642024-11-08T01:30:11.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1652024-11-08T01:30:11.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1662024-11-08T01:30:11.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672024-11-08T01:30:11.338ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1682024-11-08T01:30:11.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1692024-11-08T01:30:11.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1702024-11-08T01:30:11.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1712024-11-08T01:30:11.348ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1722024-11-08T01:30:11.349ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4958db0a-bf94-417c-b1b2-83be003657ea", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
1732024-11-08T01:30:11.349ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1742024-11-08T01:30:11.350ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1752024-11-08T01:30:11.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1762024-11-08T01:30:11.354ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1772024-11-08T01:30:11.355ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62532fab-be45-4952-b7e4-69b4a6b7125d", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
1782024-11-08T01:30:11.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1792024-11-08T01:30:11.356ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
1802024-11-08T01:30:11.356ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1812024-11-08T01:30:11.356ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33b04ea-e53e-457a-afa5-b5854b1dd6ad", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
1822024-11-08T01:30:11.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1832024-11-08T01:30:11.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1842024-11-08T01:30:11.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
1852024-11-08T01:30:11.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862024-11-08T01:30:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
1872024-11-08T01:30:11.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1882024-11-08T01:30:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1892024-11-08T01:30:11.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1902024-11-08T01:30:11.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.339116ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1912024-11-08T01:30:11.373ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.992694ms iteration = 14 status = 0
1922024-11-08T01:30:11.375ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1932024-11-08T01:30:11.375ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1942024-11-08T01:30:11.376ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1952024-11-08T01:30:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1962024-11-08T01:30:11.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1972024-11-08T01:30:11.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1982024-11-08T01:30:11.413ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1992024-11-08T01:30:11.413ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "99356eb2-9851-4003-988a-a18df860de47", "content-length": "1", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2002024-11-08T01:30:11.416ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2012024-11-08T01:30:11.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2022024-11-08T01:30:11.417ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2032024-11-08T01:30:11.417ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2042024-11-08T01:30:11.417ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.208998ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2052024-11-08T01:30:11.418ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 145.150791ms iteration = 14 status = null
2062024-11-08T01:30:11.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2072024-11-08T01:30:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2082024-11-08T01:30:11.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-11-08T01:30:11.424ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 151.459456ms iteration = 14 status = {}
2102024-11-08T01:30:11.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2112024-11-08T01:30:11.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2122024-11-08T01:30:11.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2132024-11-08T01:30:11.451ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.478809ms iteration = 17 status = {"physical_disks_added":0}
2142024-11-08T01:30:11.455ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2152024-11-08T01:30:11.455ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2162024-11-08T01:30:11.455ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbaa1e51-605e-40b8-b03e-32f938650973", "content-length": "372", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2172024-11-08T01:30:11.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2182024-11-08T01:30:11.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2192024-11-08T01:30:11.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202024-11-08T01:30:11.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2212024-11-08T01:30:11.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2222024-11-08T01:30:11.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2232024-11-08T01:30:11.470ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2242024-11-08T01:30:11.470ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2252024-11-08T01:30:11.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3eaba92f-0007-45ce-b742-33c84206e49c", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2262024-11-08T01:30:11.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2272024-11-08T01:30:11.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2282024-11-08T01:30:11.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2292024-11-08T01:30:11.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2302024-11-08T01:30:11.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2312024-11-08T01:30:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2322024-11-08T01:30:11.479ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2332024-11-08T01:30:11.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2342024-11-08T01:30:11.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6eeec111-40fe-450b-a7b1-4f16fca17e70", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2352024-11-08T01:30:11.480ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 207.758912ms iteration = 15 status = {}
2362024-11-08T01:30:11.498ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2372024-11-08T01:30:11.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "98768b99-ddd5-4263-88ca-6852b22f7806", "content-length": "691", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2382024-11-08T01:30:11.499ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2392024-11-08T01:30:11.499ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2402024-11-08T01:30:11.499ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2412024-11-08T01:30:11.499ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 226.879739ms iteration = 14 status = {}
2422024-11-08T01:30:11.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2432024-11-08T01:30:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2442024-11-08T01:30:11.509ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
2452024-11-08T01:30:11.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462024-11-08T01:30:11.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472024-11-08T01:30:11.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2482024-11-08T01:30:11.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c460b2c-c2a6-47d5-b697-193b0b3cc9f9", "content-length": "134", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2492024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2502024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
2512024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2522024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2532024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2542024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2552024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2562024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2572024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2582024-11-08T01:30:11.518ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2592024-11-08T01:30:11.519ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
2602024-11-08T01:30:11.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2612024-11-08T01:30:11.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2622024-11-08T01:30:11.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2632024-11-08T01:30:11.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e136d782-4c88-4f01-b000-056c3dbac932", "content-length": "2", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2642024-11-08T01:30:11.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2652024-11-08T01:30:11.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0bf3053-e0d6-4c38-9f86-a043870b54da", "content-length": "52", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2662024-11-08T01:30:11.521ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
2672024-11-08T01:30:11.521ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2682024-11-08T01:30:11.708ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9570679a-5b4c-4856-bbcc-43c0a8f2228c", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2692024-11-08T01:30:11.708ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
2702024-11-08T01:30:11.709ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2712024-11-08T01:30:11.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d064d373-c348-4d8f-ace0-74257b00b4e2", "content-length": "682", "date": "Fri, 08 Nov 2024 01:30:11 GMT"} })
2722024-11-08T01:30:11.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2732024-11-08T01:30:11.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2742024-11-08T01:30:11.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2752024-11-08T01:30:11.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2762024-11-08T01:30:11.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2772024-11-08T01:30:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2782024-11-08T01:30:11.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2792024-11-08T01:30:11.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2802024-11-08T01:30:11.730ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 457.384267ms iteration = 14 status = {}
2812024-11-08T01:30:11.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d7421f6a-11b7-410c-a5d2-5f4a17c9dcfd roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2822024-11-08T01:30:11.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d7421f6a-11b7-410c-a5d2-5f4a17c9dcfd resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2832024-11-08T01:30:11.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d7421f6a-11b7-410c-a5d2-5f4a17c9dcfd response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2842024-11-08T01:30:12.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d1e479a-aa45-4731-8206-eeb1b005ffa9 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2852024-11-08T01:30:12.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d1e479a-aa45-4731-8206-eeb1b005ffa9 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2862024-11-08T01:30:12.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d1e479a-aa45-4731-8206-eeb1b005ffa9 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2872024-11-08T01:30:12.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d0891ef7-059e-4ce1-b17d-6891e86bcb15 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2882024-11-08T01:30:12.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d0891ef7-059e-4ce1-b17d-6891e86bcb15 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2892024-11-08T01:30:12.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d0891ef7-059e-4ce1-b17d-6891e86bcb15 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2902024-11-08T01:30:13.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2bcfdc89-f212-4b39-a792-b1a1b380c765 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2912024-11-08T01:30:13.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2bcfdc89-f212-4b39-a792-b1a1b380c765 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2922024-11-08T01:30:13.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2bcfdc89-f212-4b39-a792-b1a1b380c765 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2932024-11-08T01:30:14.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d1c66a68-927a-4898-ab9a-ccdf633aa9d3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2942024-11-08T01:30:14.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d1c66a68-927a-4898-ab9a-ccdf633aa9d3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2952024-11-08T01:30:14.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d1c66a68-927a-4898-ab9a-ccdf633aa9d3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2962024-11-08T01:30:15.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1517 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = f4488199-4d2c-40df-b127-5af916039b20 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
2972024-11-08T01:30:15.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fba82f27-1c01-49f7-af24-2f133a29b463 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2982024-11-08T01:30:15.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fba82f27-1c01-49f7-af24-2f133a29b463 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
2992024-11-08T01:30:15.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fba82f27-1c01-49f7-af24-2f133a29b463 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3002024-11-08T01:30:16.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 47d03abe-7675-4290-8144-14f9eb666a7d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3012024-11-08T01:30:16.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 47d03abe-7675-4290-8144-14f9eb666a7d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3022024-11-08T01:30:16.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 47d03abe-7675-4290-8144-14f9eb666a7d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3032024-11-08T01:30:17.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f87cbe68-29b5-47fb-b224-a5812a66e98d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3042024-11-08T01:30:17.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f87cbe68-29b5-47fb-b224-a5812a66e98d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3052024-11-08T01:30:17.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f87cbe68-29b5-47fb-b224-a5812a66e98d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3062024-11-08T01:30:18.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1ec8f080-3cde-47fc-9d20-b9fcfef9a9ea roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3072024-11-08T01:30:18.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1ec8f080-3cde-47fc-9d20-b9fcfef9a9ea resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3082024-11-08T01:30:18.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1ec8f080-3cde-47fc-9d20-b9fcfef9a9ea response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3092024-11-08T01:30:19.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e5fb9dbd-b6b7-4301-bf4d-c5d8c8ada4f3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3102024-11-08T01:30:19.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e5fb9dbd-b6b7-4301-bf4d-c5d8c8ada4f3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3112024-11-08T01:30:19.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e5fb9dbd-b6b7-4301-bf4d-c5d8c8ada4f3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3122024-11-08T01:30:20.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ab34498d-7928-4cbc-8bcf-3bd0da4f55ea roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3132024-11-08T01:30:21.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ab34498d-7928-4cbc-8bcf-3bd0da4f55ea resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3142024-11-08T01:30:21.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ab34498d-7928-4cbc-8bcf-3bd0da4f55ea response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3152024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
3162024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
3172024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3182024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3192024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3202024-11-08T01:30:21.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3212024-11-08T01:30:21.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3222024-11-08T01:30:21.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3232024-11-08T01:30:21.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3242024-11-08T01:30:21.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3252024-11-08T01:30:21.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3262024-11-08T01:30:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3272024-11-08T01:30:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-11-08T01:30:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
3292024-11-08T01:30:21.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3302024-11-08T01:30:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3312024-11-08T01:30:21.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
3322024-11-08T01:30:21.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.474882ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
3332024-11-08T01:30:21.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3342024-11-08T01:30:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3352024-11-08T01:30:21.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.825014ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3362024-11-08T01:30:22.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 996806eb-78cf-4ad4-9c93-54d63dc33839 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3372024-11-08T01:30:22.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 996806eb-78cf-4ad4-9c93-54d63dc33839 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3382024-11-08T01:30:22.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 996806eb-78cf-4ad4-9c93-54d63dc33839 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3392024-11-08T01:30:23.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0346661d-080b-4aff-b638-38fdddd0dd5e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3402024-11-08T01:30:23.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0346661d-080b-4aff-b638-38fdddd0dd5e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3412024-11-08T01:30:23.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0346661d-080b-4aff-b638-38fdddd0dd5e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3422024-11-08T01:30:24.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6480ea-e1ed-4a1e-8012-547535add63b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3432024-11-08T01:30:24.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6480ea-e1ed-4a1e-8012-547535add63b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3442024-11-08T01:30:24.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6480ea-e1ed-4a1e-8012-547535add63b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3452024-11-08T01:30:25.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b235157e-062f-4aa0-85e4-bf4d5a64792e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3462024-11-08T01:30:25.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b235157e-062f-4aa0-85e4-bf4d5a64792e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3472024-11-08T01:30:25.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b235157e-062f-4aa0-85e4-bf4d5a64792e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3482024-11-08T01:30:26.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bab26ea6-70f1-4db5-846c-2f8d378693b4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3492024-11-08T01:30:26.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bab26ea6-70f1-4db5-846c-2f8d378693b4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3502024-11-08T01:30:26.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bab26ea6-70f1-4db5-846c-2f8d378693b4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3512024-11-08T01:30:27.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14e607a2-eed6-4a81-bf8a-d74b29ddf256 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3522024-11-08T01:30:27.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14e607a2-eed6-4a81-bf8a-d74b29ddf256 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3532024-11-08T01:30:27.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14e607a2-eed6-4a81-bf8a-d74b29ddf256 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3542024-11-08T01:30:28.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3a0620c9-e491-4de2-a79a-511c97bd14e7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3552024-11-08T01:30:28.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3a0620c9-e491-4de2-a79a-511c97bd14e7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3562024-11-08T01:30:28.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3a0620c9-e491-4de2-a79a-511c97bd14e7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3572024-11-08T01:30:29.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15eddb07-be53-493e-93b3-bc1f99e5c305 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3582024-11-08T01:30:29.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15eddb07-be53-493e-93b3-bc1f99e5c305 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3592024-11-08T01:30:29.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15eddb07-be53-493e-93b3-bc1f99e5c305 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3602024-11-08T01:30:30.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1355 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = a60f86d6-c9dc-49c7-adce-638755ccb6a0 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
3612024-11-08T01:30:30.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c74bce8c-3102-42ba-98cc-4e8ee30ff633 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3622024-11-08T01:30:30.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c74bce8c-3102-42ba-98cc-4e8ee30ff633 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3632024-11-08T01:30:30.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c74bce8c-3102-42ba-98cc-4e8ee30ff633 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3642024-11-08T01:30:31.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2706196d-6b16-4299-8853-de2a8020e791 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3652024-11-08T01:30:31.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2706196d-6b16-4299-8853-de2a8020e791 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3662024-11-08T01:30:31.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2706196d-6b16-4299-8853-de2a8020e791 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3672024-11-08T01:30:31.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
3682024-11-08T01:30:31.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
3692024-11-08T01:30:31.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3702024-11-08T01:30:31.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3712024-11-08T01:30:31.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3722024-11-08T01:30:31.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3732024-11-08T01:30:31.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742024-11-08T01:30:31.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3752024-11-08T01:30:31.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3762024-11-08T01:30:31.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3772024-11-08T01:30:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3782024-11-08T01:30:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3792024-11-08T01:30:31.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3802024-11-08T01:30:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3812024-11-08T01:30:31.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.682003ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3822024-11-08T01:30:31.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832024-11-08T01:30:31.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
3842024-11-08T01:30:31.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3852024-11-08T01:30:31.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3862024-11-08T01:30:31.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
3872024-11-08T01:30:31.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.989456ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
3882024-11-08T01:30:32.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aa81dbb2-0664-4373-91a0-1b9e80737d22 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3892024-11-08T01:30:32.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aa81dbb2-0664-4373-91a0-1b9e80737d22 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3902024-11-08T01:30:32.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aa81dbb2-0664-4373-91a0-1b9e80737d22 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3912024-11-08T01:30:33.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98f3dce6-ab3c-42e7-a00f-bf615da3ee2a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3922024-11-08T01:30:33.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98f3dce6-ab3c-42e7-a00f-bf615da3ee2a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3932024-11-08T01:30:33.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98f3dce6-ab3c-42e7-a00f-bf615da3ee2a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3942024-11-08T01:30:34.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78443b89-dd01-4893-8f5c-bce9854b1e91 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3952024-11-08T01:30:34.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78443b89-dd01-4893-8f5c-bce9854b1e91 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3962024-11-08T01:30:34.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78443b89-dd01-4893-8f5c-bce9854b1e91 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
3972024-11-08T01:30:35.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1bd92917-1180-4a58-affd-aceb6ec55f9c roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
3982024-11-08T01:30:35.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1bd92917-1180-4a58-affd-aceb6ec55f9c resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
3992024-11-08T01:30:35.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1bd92917-1180-4a58-affd-aceb6ec55f9c response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
4002024-11-08T01:30:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 11959dab-f2b5-426a-a207-0a0f0cd1b9a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
4012024-11-08T01:30:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 11959dab-f2b5-426a-a207-0a0f0cd1b9a3 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
4022024-11-08T01:30:35.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 11959dab-f2b5-426a-a207-0a0f0cd1b9a3 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
4032024-11-08T01:30:35.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bc669b6a-ec53-45df-a2c2-e66b94f2afd0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4042024-11-08T01:30:35.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bc669b6a-ec53-45df-a2c2-e66b94f2afd0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4052024-11-08T01:30:35.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bc669b6a-ec53-45df-a2c2-e66b94f2afd0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4062024-11-08T01:30:36.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f4ed31bf-df50-4212-bb8d-d5e8f37f07b1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4072024-11-08T01:30:36.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f4ed31bf-df50-4212-bb8d-d5e8f37f07b1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4082024-11-08T01:30:36.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f4ed31bf-df50-4212-bb8d-d5e8f37f07b1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4092024-11-08T01:30:37.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25289823-d877-4ff1-a15c-b3ee2db64d35 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4102024-11-08T01:30:37.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25289823-d877-4ff1-a15c-b3ee2db64d35 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4112024-11-08T01:30:37.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25289823-d877-4ff1-a15c-b3ee2db64d35 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4122024-11-08T01:30:38.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 659b183f-da07-4f40-855b-0960d6b4dbc5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4132024-11-08T01:30:38.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 659b183f-da07-4f40-855b-0960d6b4dbc5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4142024-11-08T01:30:38.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 659b183f-da07-4f40-855b-0960d6b4dbc5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4152024-11-08T01:30:39.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cfc79ad1-4148-44f8-9145-95705dfc4259 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4162024-11-08T01:30:39.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cfc79ad1-4148-44f8-9145-95705dfc4259 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4172024-11-08T01:30:39.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cfc79ad1-4148-44f8-9145-95705dfc4259 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4182024-11-08T01:30:40.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 459f6567-398a-44e3-9dbd-dbc631703373 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4192024-11-08T01:30:40.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 459f6567-398a-44e3-9dbd-dbc631703373 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4202024-11-08T01:30:40.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 459f6567-398a-44e3-9dbd-dbc631703373 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
4212024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
4222024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
4232024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
4242024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4252024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4262024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4272024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4282024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4292024-11-08T01:30:41.273ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
4302024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4312024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.16\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
4322024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
4332024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4342024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
4352024-11-08T01:30:41.273ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4362024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4372024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4382024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4392024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
4402024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4412024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
4422024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4432024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4442024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4452024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4462024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
4472024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
4482024-11-08T01:30:41.273ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4492024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
4502024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4512024-11-08T01:30:41.273ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:20:41.273621160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4522024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
4532024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4542024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4552024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
4562024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4572024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
4582024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.03\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4592024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
4602024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
4612024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4622024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
4632024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
4642024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4652024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4662024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4672024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4682024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
4692024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4702024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
4712024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4722024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4732024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
4742024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.481\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
4752024-11-08T01:30:41.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
4762024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
4772024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.38\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4782024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4792024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4802024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4812024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
4822024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4832024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4842024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4852024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4862024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4872024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4882024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4892024-11-08T01:30:41.274ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 485496037 } })
4902024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4912024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4922024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4932024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4942024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4952024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4962024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4972024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4982024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4992024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5002024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5022024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5032024-11-08T01:30:41.274ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 485656210 } })
5042024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5052024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5062024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 999.954\u{b5}s iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5072024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
5082024-11-08T01:30:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.067674ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5092024-11-08T01:30:41.277ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 488465307 } })
5102024-11-08T01:30:41.277ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.346325ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5112024-11-08T01:30:41.277ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5122024-11-08T01:30:41.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5132024-11-08T01:30:41.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5142024-11-08T01:30:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5152024-11-08T01:30:41.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5162024-11-08T01:30:41.279ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5172024-11-08T01:30:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5182024-11-08T01:30:41.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5192024-11-08T01:30:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5202024-11-08T01:30:41.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-11-08T01:30:41.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5222024-11-08T01:30:41.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5232024-11-08T01:30:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5242024-11-08T01:30:41.282ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 494275045 } })
5252024-11-08T01:30:41.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5262024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5272024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5282024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5292024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5302024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5312024-11-08T01:30:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5322024-11-08T01:30:41.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:20:41.273621160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5332024-11-08T01:30:41.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.958437ms iteration = 8 status = {"expiration":"2024-11-08T01:20:41.273621160Z","pruned":[]}
5342024-11-08T01:30:41.286ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.475967ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
5352024-11-08T01:30:41.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5362024-11-08T01:30:41.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-11-08T01:30:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5382024-11-08T01:30:41.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5392024-11-08T01:30:41.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402024-11-08T01:30:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5412024-11-08T01:30:41.288ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5422024-11-08T01:30:41.288ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5432024-11-08T01:30:41.288ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.834499ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5442024-11-08T01:30:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5452024-11-08T01:30:41.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5462024-11-08T01:30:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5472024-11-08T01:30:41.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5482024-11-08T01:30:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5492024-11-08T01:30:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5502024-11-08T01:30:41.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-11-08T01:30:41.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5522024-11-08T01:30:41.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5532024-11-08T01:30:41.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5542024-11-08T01:30:41.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-11-08T01:30:41.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5562024-11-08T01:30:41.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5572024-11-08T01:30:41.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5582024-11-08T01:30:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5592024-11-08T01:30:41.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5602024-11-08T01:30:41.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5612024-11-08T01:30:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5622024-11-08T01:30:41.301ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
5632024-11-08T01:30:41.301ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
5642024-11-08T01:30:41.301ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
5652024-11-08T01:30:41.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5662024-11-08T01:30:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5672024-11-08T01:30:41.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-11-08T01:30:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5692024-11-08T01:30:41.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5702024-11-08T01:30:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5712024-11-08T01:30:41.310ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
5722024-11-08T01:30:41.310ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
5732024-11-08T01:30:41.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5742024-11-08T01:30:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5752024-11-08T01:30:41.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-08T01:30:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5772024-11-08T01:30:41.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5782024-11-08T01:30:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5792024-11-08T01:30:41.324ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
5802024-11-08T01:30:41.324ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
5812024-11-08T01:30:41.324ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
5822024-11-08T01:30:41.324ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 50.61128ms iteration = 9 status = {"generation":1}
5832024-11-08T01:30:41.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842024-11-08T01:30:41.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-08T01:30:41.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5872024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5882024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5892024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5902024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5912024-11-08T01:30:41.333ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5932024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5942024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5952024-11-08T01:30:41.334ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5962024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5972024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5982024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5992024-11-08T01:30:41.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6002024-11-08T01:30:41.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6012024-11-08T01:30:41.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6022024-11-08T01:30:41.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6032024-11-08T01:30:41.336ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6042024-11-08T01:30:41.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6052024-11-08T01:30:41.339ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6062024-11-08T01:30:41.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6072024-11-08T01:30:41.339ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 550931517 } })
6082024-11-08T01:30:41.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-08T01:30:41.339ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
6102024-11-08T01:30:41.339ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6112024-11-08T01:30:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6122024-11-08T01:30:41.340ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6132024-11-08T01:30:41.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6142024-11-08T01:30:41.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152024-11-08T01:30:41.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.258157ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6162024-11-08T01:30:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
6172024-11-08T01:30:41.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6182024-11-08T01:30:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6192024-11-08T01:30:41.345ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6202024-11-08T01:30:41.345ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6212024-11-08T01:30:41.345ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.765775ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6222024-11-08T01:30:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
6232024-11-08T01:30:41.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6242024-11-08T01:30:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6252024-11-08T01:30:41.346ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-11-08T01:30:41.347ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.010135ms iteration = 15 status = 0
6272024-11-08T01:30:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6282024-11-08T01:30:41.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6292024-11-08T01:30:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6302024-11-08T01:30:41.356ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6312024-11-08T01:30:41.356ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.498559ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6322024-11-08T01:30:41.357ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
6332024-11-08T01:30:41.357ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.104021ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
6342024-11-08T01:30:41.394ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6352024-11-08T01:30:41.394ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6362024-11-08T01:30:41.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6372024-11-08T01:30:41.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.833464ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6382024-11-08T01:30:41.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6392024-11-08T01:30:41.396ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6402024-11-08T01:30:41.396ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6412024-11-08T01:30:41.396ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6422024-11-08T01:30:41.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6432024-11-08T01:30:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6442024-11-08T01:30:41.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6452024-11-08T01:30:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6462024-11-08T01:30:41.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6472024-11-08T01:30:41.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6482024-11-08T01:30:41.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6492024-11-08T01:30:41.433ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6502024-11-08T01:30:41.433ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6512024-11-08T01:30:41.433ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76c79dc6-1996-4c54-ac85-0d7ffa1d901e", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
6522024-11-08T01:30:41.433ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6532024-11-08T01:30:41.435ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6542024-11-08T01:30:41.437ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6552024-11-08T01:30:41.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6562024-11-08T01:30:41.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6572024-11-08T01:30:41.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6582024-11-08T01:30:41.446ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6592024-11-08T01:30:41.446ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20f5bc6d-4623-475e-bd76-6c73f134f354", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
6602024-11-08T01:30:41.446ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6612024-11-08T01:30:41.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6622024-11-08T01:30:41.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a377af5c-002e-4474-a61b-f936ed4633ec roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
6632024-11-08T01:30:41.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a377af5c-002e-4474-a61b-f936ed4633ec resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
6642024-11-08T01:30:41.488ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.704996ms iteration = 18 status = {"physical_disks_added":0}
6652024-11-08T01:30:41.593ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 319.637326ms iteration = 15 status = {}
6662024-11-08T01:30:41.607ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
6672024-11-08T01:30:41.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
6682024-11-08T01:30:41.609ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6692024-11-08T01:30:41.609ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59be08c8-1e90-43e6-98a7-61d2fc61e8d9", "content-length": "26", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
6702024-11-08T01:30:41.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6712024-11-08T01:30:41.611ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
6722024-11-08T01:30:41.613ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6732024-11-08T01:30:41.613ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "44296e00-c0c3-4444-8726-5ec20a81426d", "content-length": "1", "date": "Fri, 08 Nov 2024 01:30:40 GMT"} })
6742024-11-08T01:30:41.615ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6752024-11-08T01:30:41.615ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6762024-11-08T01:30:41.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "70ef34a3-ce63-4fa7-9a1c-7b3b29e53d0f", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6772024-11-08T01:30:41.615ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6782024-11-08T01:30:41.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6792024-11-08T01:30:41.617ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b62dc1b1-cdc1-408b-a2f0-6616f8012364", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6802024-11-08T01:30:41.617ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6812024-11-08T01:30:41.619ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6822024-11-08T01:30:41.619ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 346.216813ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
6832024-11-08T01:30:41.632ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6842024-11-08T01:30:41.632ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6852024-11-08T01:30:41.633ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "86c30c9d-f7c6-4123-a9a2-38434959776a", "content-length": "372", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
6862024-11-08T01:30:41.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6872024-11-08T01:30:41.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6882024-11-08T01:30:41.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-11-08T01:30:41.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902024-11-08T01:30:41.636ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-11-08T01:30:41.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a377af5c-002e-4474-a61b-f936ed4633ec response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
6922024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6932024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6942024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6952024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6962024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6972024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6982024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6992024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002024-11-08T01:30:41.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7012024-11-08T01:30:41.641ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 367.355418ms iteration = 15 status = null
7022024-11-08T01:30:41.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7032024-11-08T01:30:41.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7042024-11-08T01:30:41.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7052024-11-08T01:30:41.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7062024-11-08T01:30:41.671ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7072024-11-08T01:30:41.671ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7082024-11-08T01:30:41.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 397.837238ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7092024-11-08T01:30:41.676ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7102024-11-08T01:30:41.676ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
7112024-11-08T01:30:41.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7122024-11-08T01:30:41.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7132024-11-08T01:30:41.694ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) }
7142024-11-08T01:30:41.694ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 421.401664ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7152024-11-08T01:30:41.696ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7162024-11-08T01:30:41.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "50b9a7dd-8893-4c13-bd1c-487adedc9b2e", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7172024-11-08T01:30:41.697ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7182024-11-08T01:30:41.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "28e3444a-a3a5-4eae-9af0-b008f6992f20", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7192024-11-08T01:30:41.699ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7202024-11-08T01:30:41.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "45cdec43-ae40-49cd-98f5-7b89b0e166c0", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7212024-11-08T01:30:41.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7222024-11-08T01:30:41.702ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7232024-11-08T01:30:41.702ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 429.098547ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7242024-11-08T01:30:41.706ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7252024-11-08T01:30:41.706ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7262024-11-08T01:30:41.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a7a9d29c-d81b-4106-afb2-811eae64c693", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7272024-11-08T01:30:41.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7282024-11-08T01:30:41.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7292024-11-08T01:30:41.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7302024-11-08T01:30:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7312024-11-08T01:30:41.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7322024-11-08T01:30:41.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7332024-11-08T01:30:41.715ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7342024-11-08T01:30:41.715ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7352024-11-08T01:30:41.715ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50bbf673-7f5a-474a-9303-ff017ab76a06", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7362024-11-08T01:30:41.718ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.789019ms iteration = 16 status = {}
7372024-11-08T01:30:41.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382024-11-08T01:30:41.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7392024-11-08T01:30:41.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7402024-11-08T01:30:41.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7412024-11-08T01:30:41.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7422024-11-08T01:30:41.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "07b5e2ee-53ed-4e5e-a66f-09f69d7b8d20", "content-length": "691", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7432024-11-08T01:30:41.734ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7442024-11-08T01:30:41.734ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7452024-11-08T01:30:41.734ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7462024-11-08T01:30:41.735ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
7472024-11-08T01:30:41.735ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7482024-11-08T01:30:41.735ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
7492024-11-08T01:30:41.736ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 462.253313ms iteration = 9 status = {"generation":2}
7502024-11-08T01:30:41.736ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 463.116375ms iteration = 15 status = {}
7512024-11-08T01:30:41.738ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7522024-11-08T01:30:41.738ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 465.048221ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7532024-11-08T01:30:41.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7542024-11-08T01:30:41.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7552024-11-08T01:30:41.781ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
7562024-11-08T01:30:41.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7572024-11-08T01:30:41.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7582024-11-08T01:30:41.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7592024-11-08T01:30:41.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dec065bf-b702-4501-bd2b-0875324f198b", "content-length": "134", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7602024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7612024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
7622024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7632024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7642024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7652024-11-08T01:30:41.792ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7662024-11-08T01:30:41.793ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7672024-11-08T01:30:41.793ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7682024-11-08T01:30:41.793ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7692024-11-08T01:30:41.793ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7702024-11-08T01:30:41.793ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
7712024-11-08T01:30:41.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7722024-11-08T01:30:41.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7732024-11-08T01:30:41.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7742024-11-08T01:30:41.795ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4fe1e20-a071-480f-881f-59ca1e2fb5a6", "content-length": "2", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7752024-11-08T01:30:41.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7762024-11-08T01:30:41.795ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "383b088d-41e8-4c3e-a63e-e3a782ea0612", "content-length": "52", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7772024-11-08T01:30:41.795ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
7782024-11-08T01:30:41.795ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7792024-11-08T01:30:41.982ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9233104e-1b2f-4752-b051-29db2f42554e", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7802024-11-08T01:30:41.982ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
7812024-11-08T01:30:41.982ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7822024-11-08T01:30:41.982ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5162da67-aa9b-4e8f-8025-ff5c5f649df9", "content-length": "682", "date": "Fri, 08 Nov 2024 01:30:41 GMT"} })
7832024-11-08T01:30:41.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7842024-11-08T01:30:41.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7852024-11-08T01:30:41.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7862024-11-08T01:30:41.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7872024-11-08T01:30:41.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7882024-11-08T01:30:41.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7892024-11-08T01:30:41.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7902024-11-08T01:30:41.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7912024-11-08T01:30:42.001ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 727.58765ms iteration = 15 status = {}
7922024-11-08T01:30:42.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb4c215b-0313-4f13-bc7a-fe321b8e9826 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
7932024-11-08T01:30:42.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb4c215b-0313-4f13-bc7a-fe321b8e9826 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
7942024-11-08T01:30:42.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb4c215b-0313-4f13-bc7a-fe321b8e9826 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
7952024-11-08T01:30:42.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = cebe6557-6a13-4fd2-8a3d-570c86d24845 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7962024-11-08T01:30:42.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = cebe6557-6a13-4fd2-8a3d-570c86d24845 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7972024-11-08T01:30:42.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = cebe6557-6a13-4fd2-8a3d-570c86d24845 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7982024-11-08T01:30:43.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ea71b3d1-3a15-4cd9-9949-a913c8f172f9 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
7992024-11-08T01:30:43.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ea71b3d1-3a15-4cd9-9949-a913c8f172f9 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8002024-11-08T01:30:43.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ea71b3d1-3a15-4cd9-9949-a913c8f172f9 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8012024-11-08T01:30:44.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8c0cdab-2c63-47d3-afdf-1235bfce3b71 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8022024-11-08T01:30:44.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8c0cdab-2c63-47d3-afdf-1235bfce3b71 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8032024-11-08T01:30:44.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8c0cdab-2c63-47d3-afdf-1235bfce3b71 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8042024-11-08T01:30:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1390 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 0df48ca0-258e-44bd-80d6-970ea627234b response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
8052024-11-08T01:30:45.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e10a8e5-cdac-44c7-8539-e5b3e9f9f8fb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8062024-11-08T01:30:45.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e10a8e5-cdac-44c7-8539-e5b3e9f9f8fb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8072024-11-08T01:30:45.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e10a8e5-cdac-44c7-8539-e5b3e9f9f8fb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8082024-11-08T01:30:46.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9eff50f6-5859-4ec4-92f2-d27be71fa918 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8092024-11-08T01:30:46.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9eff50f6-5859-4ec4-92f2-d27be71fa918 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8102024-11-08T01:30:46.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9eff50f6-5859-4ec4-92f2-d27be71fa918 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8112024-11-08T01:30:47.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb639777-cacb-4ea5-878a-47c99620546f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8122024-11-08T01:30:47.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb639777-cacb-4ea5-878a-47c99620546f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8132024-11-08T01:30:47.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb639777-cacb-4ea5-878a-47c99620546f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8142024-11-08T01:30:48.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0a95cc5-d4ff-45c6-aa2a-0c634209e337 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8152024-11-08T01:30:48.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0a95cc5-d4ff-45c6-aa2a-0c634209e337 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8162024-11-08T01:30:48.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0a95cc5-d4ff-45c6-aa2a-0c634209e337 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8172024-11-08T01:30:49.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 68c98b9d-7139-4fa4-8a8e-ee05bb6d62dc roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8182024-11-08T01:30:49.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 68c98b9d-7139-4fa4-8a8e-ee05bb6d62dc resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8192024-11-08T01:30:49.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 68c98b9d-7139-4fa4-8a8e-ee05bb6d62dc response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8202024-11-08T01:30:50.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b9052f1a-0ead-403e-9aca-e8acdc24e78c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8212024-11-08T01:30:50.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b9052f1a-0ead-403e-9aca-e8acdc24e78c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8222024-11-08T01:30:50.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b9052f1a-0ead-403e-9aca-e8acdc24e78c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8232024-11-08T01:30:51.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
8242024-11-08T01:30:51.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
8252024-11-08T01:30:51.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8262024-11-08T01:30:51.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8272024-11-08T01:30:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8282024-11-08T01:30:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8292024-11-08T01:30:51.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8302024-11-08T01:30:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8312024-11-08T01:30:51.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8322024-11-08T01:30:51.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.163212ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8332024-11-08T01:30:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8342024-11-08T01:30:51.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8352024-11-08T01:30:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8362024-11-08T01:30:51.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8372024-11-08T01:30:51.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8382024-11-08T01:30:51.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8392024-11-08T01:30:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
8402024-11-08T01:30:51.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8412024-11-08T01:30:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8422024-11-08T01:30:51.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
8432024-11-08T01:30:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.951531ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
8442024-11-08T01:30:51.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb15bee1-5ad7-4966-94bd-fb5c52be8de5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8452024-11-08T01:30:51.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb15bee1-5ad7-4966-94bd-fb5c52be8de5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8462024-11-08T01:30:51.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb15bee1-5ad7-4966-94bd-fb5c52be8de5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8472024-11-08T01:30:52.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0961a28d-dac0-4b60-9f24-3b9c28ca8b2d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8482024-11-08T01:30:52.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0961a28d-dac0-4b60-9f24-3b9c28ca8b2d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8492024-11-08T01:30:52.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0961a28d-dac0-4b60-9f24-3b9c28ca8b2d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8502024-11-08T01:30:53.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 752c480e-d2cd-4361-9851-e17ae4b9c54a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8512024-11-08T01:30:53.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 752c480e-d2cd-4361-9851-e17ae4b9c54a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8522024-11-08T01:30:53.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 752c480e-d2cd-4361-9851-e17ae4b9c54a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8532024-11-08T01:30:54.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 39f07ff9-adea-4eea-8019-79af825750b8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8542024-11-08T01:30:54.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 39f07ff9-adea-4eea-8019-79af825750b8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8552024-11-08T01:30:54.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 39f07ff9-adea-4eea-8019-79af825750b8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8562024-11-08T01:30:55.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74adba8a-6a5f-4077-992a-d0814565c66e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8572024-11-08T01:30:55.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74adba8a-6a5f-4077-992a-d0814565c66e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8582024-11-08T01:30:55.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74adba8a-6a5f-4077-992a-d0814565c66e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8592024-11-08T01:30:56.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01342a40-7a04-42af-bbfa-9cabc9be129e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8602024-11-08T01:30:56.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01342a40-7a04-42af-bbfa-9cabc9be129e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8612024-11-08T01:30:56.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01342a40-7a04-42af-bbfa-9cabc9be129e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8622024-11-08T01:30:57.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7de9606b-df63-43f3-be74-4c47eed32c35 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8632024-11-08T01:30:57.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7de9606b-df63-43f3-be74-4c47eed32c35 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8642024-11-08T01:30:57.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7de9606b-df63-43f3-be74-4c47eed32c35 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8652024-11-08T01:30:59.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b1070e4-8423-422d-b937-c604ad8fc2fb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8662024-11-08T01:30:59.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b1070e4-8423-422d-b937-c604ad8fc2fb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8672024-11-08T01:30:59.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b1070e4-8423-422d-b937-c604ad8fc2fb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8682024-11-08T01:31:00.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c210fee-3edf-460a-a052-d6f5559c14e1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8692024-11-08T01:31:00.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c210fee-3edf-460a-a052-d6f5559c14e1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8702024-11-08T01:31:00.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c210fee-3edf-460a-a052-d6f5559c14e1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8712024-11-08T01:31:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1529 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 4f1a8a0f-cf6b-4f8e-8330-a617b66ca408 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
8722024-11-08T01:31:01.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ecc5f39a-d7dd-4695-9edc-c1e4024e5ad1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8732024-11-08T01:31:01.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ecc5f39a-d7dd-4695-9edc-c1e4024e5ad1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8742024-11-08T01:31:01.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ecc5f39a-d7dd-4695-9edc-c1e4024e5ad1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8752024-11-08T01:31:01.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
8762024-11-08T01:31:01.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
8772024-11-08T01:31:01.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8782024-11-08T01:31:01.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8792024-11-08T01:31:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8802024-11-08T01:31:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8812024-11-08T01:31:01.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-11-08T01:31:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8832024-11-08T01:31:01.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8842024-11-08T01:31:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8852024-11-08T01:31:01.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8862024-11-08T01:31:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8872024-11-08T01:31:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8882024-11-08T01:31:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8892024-11-08T01:31:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8902024-11-08T01:31:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
8912024-11-08T01:31:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8922024-11-08T01:31:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8932024-11-08T01:31:01.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
8942024-11-08T01:31:01.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.250239ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
8952024-11-08T01:31:01.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.69813ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8962024-11-08T01:31:02.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8daa60b5-5240-49a6-8c9f-686659b6b845 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8972024-11-08T01:31:02.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8daa60b5-5240-49a6-8c9f-686659b6b845 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8982024-11-08T01:31:02.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8daa60b5-5240-49a6-8c9f-686659b6b845 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
8992024-11-08T01:31:03.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3dabea8b-6709-48b3-b991-bba5ea473ca5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9002024-11-08T01:31:03.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3dabea8b-6709-48b3-b991-bba5ea473ca5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9012024-11-08T01:31:03.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3dabea8b-6709-48b3-b991-bba5ea473ca5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9022024-11-08T01:31:04.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 467a9d6f-5dce-40dd-9c97-0448a55ff10f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9032024-11-08T01:31:04.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 467a9d6f-5dce-40dd-9c97-0448a55ff10f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9042024-11-08T01:31:04.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 467a9d6f-5dce-40dd-9c97-0448a55ff10f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9052024-11-08T01:31:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ccfc0345-27b8-4fb6-a19b-8812b1cbfb6f roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
9062024-11-08T01:31:05.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ccfc0345-27b8-4fb6-a19b-8812b1cbfb6f resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
9072024-11-08T01:31:05.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ccfc0345-27b8-4fb6-a19b-8812b1cbfb6f response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
9082024-11-08T01:31:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1681db80-45d9-402f-a5e2-7aafefecaf21 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
9092024-11-08T01:31:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1681db80-45d9-402f-a5e2-7aafefecaf21 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
9102024-11-08T01:31:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 1681db80-45d9-402f-a5e2-7aafefecaf21 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
9112024-11-08T01:31:05.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a654e05f-b2cc-486f-b3a8-344547a16f30 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9122024-11-08T01:31:05.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a654e05f-b2cc-486f-b3a8-344547a16f30 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9132024-11-08T01:31:05.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a654e05f-b2cc-486f-b3a8-344547a16f30 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9142024-11-08T01:31:06.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93dc7edd-6f72-4bb6-8ab3-32747635736f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9152024-11-08T01:31:06.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93dc7edd-6f72-4bb6-8ab3-32747635736f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9162024-11-08T01:31:06.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93dc7edd-6f72-4bb6-8ab3-32747635736f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9172024-11-08T01:31:07.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 142d14cf-f98b-46ef-99f3-f1ade23ebcc1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9182024-11-08T01:31:07.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 142d14cf-f98b-46ef-99f3-f1ade23ebcc1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9192024-11-08T01:31:07.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 142d14cf-f98b-46ef-99f3-f1ade23ebcc1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9202024-11-08T01:31:08.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf7d60d1-250a-45df-bcf0-d087b1767422 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9212024-11-08T01:31:08.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf7d60d1-250a-45df-bcf0-d087b1767422 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9222024-11-08T01:31:08.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf7d60d1-250a-45df-bcf0-d087b1767422 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9232024-11-08T01:31:09.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d83f6c5f-e73a-4d5a-8c3d-74d4f8e48ddf roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9242024-11-08T01:31:09.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d83f6c5f-e73a-4d5a-8c3d-74d4f8e48ddf resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9252024-11-08T01:31:09.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d83f6c5f-e73a-4d5a-8c3d-74d4f8e48ddf response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9262024-11-08T01:31:10.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e06de1aa-ce56-4492-84ba-0c0f15d5c903 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9272024-11-08T01:31:10.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e06de1aa-ce56-4492-84ba-0c0f15d5c903 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9282024-11-08T01:31:10.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e06de1aa-ce56-4492-84ba-0c0f15d5c903 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
9292024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
9302024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
9312024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9322024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
9332024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.49\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
9342024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.571\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9352024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
9362024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
9372024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.269\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
9382024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
9392024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
9402024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9412024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9422024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.03\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9432024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
9442024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9452024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
9462024-11-08T01:31:11.273ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9472024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
9482024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
9492024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9502024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9512024-11-08T01:31:11.273ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
9522024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9532024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9542024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
9552024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9562024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
9572024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9582024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
9592024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9602024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
9612024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9622024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
9632024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9642024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9652024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9662024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9672024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9682024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9692024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9702024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9712024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9722024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9732024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9742024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9752024-11-08T01:31:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9762024-11-08T01:31:11.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9772024-11-08T01:31:11.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782024-11-08T01:31:11.276ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.157122ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9792024-11-08T01:31:11.277ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9802024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9812024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9822024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9832024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9842024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852024-11-08T01:31:11.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9862024-11-08T01:31:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9872024-11-08T01:31:11.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9882024-11-08T01:31:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9892024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9902024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9912024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9922024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9932024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9942024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9952024-11-08T01:31:11.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9962024-11-08T01:31:11.281ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9972024-11-08T01:31:11.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-11-08T01:31:11.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 494342956 } })
9992024-11-08T01:31:11.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
10002024-11-08T01:31:11.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 495117577 } })
10012024-11-08T01:31:11.284ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
10022024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10032024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10042024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10052024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10062024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10072024-11-08T01:31:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10082024-11-08T01:31:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10092024-11-08T01:31:11.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10102024-11-08T01:31:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10112024-11-08T01:31:11.287ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10122024-11-08T01:31:11.287ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10132024-11-08T01:31:11.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10142024-11-08T01:31:11.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10152024-11-08T01:31:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10162024-11-08T01:31:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10172024-11-08T01:31:11.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10182024-11-08T01:31:11.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10192024-11-08T01:31:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10202024-11-08T01:31:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10212024-11-08T01:31:11.289ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 500851944 } })
10222024-11-08T01:31:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10232024-11-08T01:31:11.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
10242024-11-08T01:31:11.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10252024-11-08T01:31:11.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10262024-11-08T01:31:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10272024-11-08T01:31:11.293ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10282024-11-08T01:31:11.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.470732ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10292024-11-08T01:31:11.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-11-08T01:31:11.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de78c0b0-0dc7-43bc-af4e-ad5d7c3f5e73 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
10312024-11-08T01:31:11.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
10322024-11-08T01:31:11.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10332024-11-08T01:31:11.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de78c0b0-0dc7-43bc-af4e-ad5d7c3f5e73 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
10342024-11-08T01:31:11.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10352024-11-08T01:31:11.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de78c0b0-0dc7-43bc-af4e-ad5d7c3f5e73 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
10362024-11-08T01:31:11.309ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
10372024-11-08T01:31:11.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.67658ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
10382024-11-08T01:31:11.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10392024-11-08T01:31:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10402024-11-08T01:31:11.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412024-11-08T01:31:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10422024-11-08T01:31:11.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-11-08T01:31:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10442024-11-08T01:31:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10452024-11-08T01:31:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
10462024-11-08T01:31:11.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10472024-11-08T01:31:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10482024-11-08T01:31:11.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.89037ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10492024-11-08T01:31:11.324ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.646581ms iteration = 16 status = 0
10502024-11-08T01:31:11.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512024-11-08T01:31:11.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.065186ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10522024-11-08T01:31:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10532024-11-08T01:31:11.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10542024-11-08T01:31:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10552024-11-08T01:31:11.332ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10562024-11-08T01:31:11.333ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10572024-11-08T01:31:11.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.240336ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10582024-11-08T01:31:11.378ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10592024-11-08T01:31:11.378ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10602024-11-08T01:31:11.379ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccc196a0-0289-494c-a76e-0e6582302aa7", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
10612024-11-08T01:31:11.379ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10622024-11-08T01:31:11.381ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10632024-11-08T01:31:11.384ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.527685ms iteration = 19 status = {"physical_disks_added":0}
10642024-11-08T01:31:11.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10652024-11-08T01:31:11.394ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10662024-11-08T01:31:11.394ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac682d0a-42c0-4e70-bab9-c8123468c799", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
10672024-11-08T01:31:11.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10682024-11-08T01:31:11.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
10692024-11-08T01:31:11.396ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10702024-11-08T01:31:11.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10712024-11-08T01:31:11.397ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af29bc2-570d-4334-b0dc-f5962993fe75", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
10722024-11-08T01:31:11.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10732024-11-08T01:31:11.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
10742024-11-08T01:31:11.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10752024-11-08T01:31:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10762024-11-08T01:31:11.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10772024-11-08T01:31:11.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10782024-11-08T01:31:11.490ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10792024-11-08T01:31:11.491ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dd88c49-2ed7-4fb7-9843-b4792220409c", "content-length": "1", "date": "Fri, 08 Nov 2024 01:31:10 GMT"} })
10802024-11-08T01:31:11.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10812024-11-08T01:31:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10822024-11-08T01:31:11.502ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10832024-11-08T01:31:11.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10842024-11-08T01:31:11.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-11-08T01:31:11.504ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 230.942824ms iteration = 16 status = null
10862024-11-08T01:31:11.505ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10872024-11-08T01:31:11.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10882024-11-08T01:31:11.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10892024-11-08T01:31:11.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-11-08T01:31:11.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10912024-11-08T01:31:11.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10922024-11-08T01:31:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10932024-11-08T01:31:11.513ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 239.308056ms iteration = 16 status = {}
10942024-11-08T01:31:11.550ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10952024-11-08T01:31:11.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10962024-11-08T01:31:11.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10972024-11-08T01:31:11.579ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
10982024-11-08T01:31:11.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10992024-11-08T01:31:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11002024-11-08T01:31:11.587ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11012024-11-08T01:31:11.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d9ee118-b7ab-44b1-a4c4-3a792638fbf2", "content-length": "134", "date": "Fri, 08 Nov 2024 01:31:10 GMT"} })
11022024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11032024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
11042024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11052024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11062024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11072024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11082024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11092024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11102024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11112024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11122024-11-08T01:31:11.588ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
11132024-11-08T01:31:11.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11142024-11-08T01:31:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11152024-11-08T01:31:11.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11162024-11-08T01:31:11.590ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "359353e3-2daf-4e92-b256-5c0321f28c9d", "content-length": "2", "date": "Fri, 08 Nov 2024 01:31:10 GMT"} })
11172024-11-08T01:31:11.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11182024-11-08T01:31:11.590ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0774aace-19ba-4d43-b08e-fcc7a266d521", "content-length": "52", "date": "Fri, 08 Nov 2024 01:31:10 GMT"} })
11192024-11-08T01:31:11.590ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
11202024-11-08T01:31:11.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11212024-11-08T01:31:11.600ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b548517-011a-4b2e-bffd-988da9582011", "content-length": "691", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11222024-11-08T01:31:11.601ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11232024-11-08T01:31:11.601ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11242024-11-08T01:31:11.601ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11252024-11-08T01:31:11.601ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17d7abb4-518a-469d-bac7-d825c8f350db", "content-length": "372", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11262024-11-08T01:31:11.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11272024-11-08T01:31:11.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11282024-11-08T01:31:11.602ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 328.372533ms iteration = 16 status = {}
11292024-11-08T01:31:11.614ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11302024-11-08T01:31:11.614ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11312024-11-08T01:31:11.614ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "25a20eb9-880b-4586-abc9-94721d180fe6", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11322024-11-08T01:31:11.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11332024-11-08T01:31:11.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11342024-11-08T01:31:11.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11352024-11-08T01:31:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11362024-11-08T01:31:11.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11372024-11-08T01:31:11.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11382024-11-08T01:31:11.623ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11392024-11-08T01:31:11.623ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11402024-11-08T01:31:11.624ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "523a3fea-73d8-45bd-a52d-5e50cc26ba95", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11412024-11-08T01:31:11.625ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 351.882199ms iteration = 17 status = {}
11422024-11-08T01:31:11.698ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5057629-a21b-4c5b-b9d8-0fa9b7d1f613", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11432024-11-08T01:31:11.698ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
11442024-11-08T01:31:11.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11452024-11-08T01:31:11.700ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "651bf5e4-9f1d-45f5-bd18-11684dcb8260", "content-length": "682", "date": "Fri, 08 Nov 2024 01:31:11 GMT"} })
11462024-11-08T01:31:11.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11472024-11-08T01:31:11.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11482024-11-08T01:31:11.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11492024-11-08T01:31:11.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11502024-11-08T01:31:11.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11512024-11-08T01:31:11.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11522024-11-08T01:31:11.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11532024-11-08T01:31:11.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11542024-11-08T01:31:11.715ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 441.328892ms iteration = 16 status = {}
11552024-11-08T01:31:11.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = dd922a93-3d03-4dfd-aa3b-6a428965a0d3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11562024-11-08T01:31:11.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = dd922a93-3d03-4dfd-aa3b-6a428965a0d3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11572024-11-08T01:31:11.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = dd922a93-3d03-4dfd-aa3b-6a428965a0d3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11582024-11-08T01:31:12.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e1100c9c-557b-469a-9d92-d2e8b84ce3d5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11592024-11-08T01:31:12.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e1100c9c-557b-469a-9d92-d2e8b84ce3d5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11602024-11-08T01:31:12.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e1100c9c-557b-469a-9d92-d2e8b84ce3d5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11612024-11-08T01:31:13.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c5810b7-2003-439c-b872-d16c56ea2097 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11622024-11-08T01:31:13.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c5810b7-2003-439c-b872-d16c56ea2097 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11632024-11-08T01:31:13.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c5810b7-2003-439c-b872-d16c56ea2097 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11642024-11-08T01:31:14.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eda706d8-6497-439a-b098-4be1c7b142dc roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11652024-11-08T01:31:14.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eda706d8-6497-439a-b098-4be1c7b142dc resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11662024-11-08T01:31:14.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eda706d8-6497-439a-b098-4be1c7b142dc response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11672024-11-08T01:31:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = e7f807d8-5c4a-40fb-b024-b1f81f97a266 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
11682024-11-08T01:31:15.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 57f72497-b9ee-4946-b8f7-fc6e39e9c196 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11692024-11-08T01:31:15.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 57f72497-b9ee-4946-b8f7-fc6e39e9c196 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11702024-11-08T01:31:15.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 57f72497-b9ee-4946-b8f7-fc6e39e9c196 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11712024-11-08T01:31:16.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d7cb361-e504-4e64-bb75-f4c80673c9f4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11722024-11-08T01:31:16.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d7cb361-e504-4e64-bb75-f4c80673c9f4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11732024-11-08T01:31:16.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d7cb361-e504-4e64-bb75-f4c80673c9f4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11742024-11-08T01:31:17.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6ba168-7291-4e56-ab25-17e5370625b5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11752024-11-08T01:31:17.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6ba168-7291-4e56-ab25-17e5370625b5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11762024-11-08T01:31:17.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8b6ba168-7291-4e56-ab25-17e5370625b5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11772024-11-08T01:31:18.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f15be28-d60f-46a8-a836-805bef5da484 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11782024-11-08T01:31:18.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f15be28-d60f-46a8-a836-805bef5da484 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11792024-11-08T01:31:18.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f15be28-d60f-46a8-a836-805bef5da484 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11802024-11-08T01:31:19.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71c0a811-7e27-47e9-bd1d-dae66234fb2c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11812024-11-08T01:31:19.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71c0a811-7e27-47e9-bd1d-dae66234fb2c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11822024-11-08T01:31:19.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71c0a811-7e27-47e9-bd1d-dae66234fb2c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11832024-11-08T01:31:20.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ed70db-9a7d-4bd2-bd87-3c4f118c940f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11842024-11-08T01:31:20.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ed70db-9a7d-4bd2-bd87-3c4f118c940f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11852024-11-08T01:31:20.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ed70db-9a7d-4bd2-bd87-3c4f118c940f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
11862024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
11872024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
11882024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11892024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11902024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11912024-11-08T01:31:21.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11922024-11-08T01:31:21.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-11-08T01:31:21.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11942024-11-08T01:31:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11952024-11-08T01:31:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.653322ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11962024-11-08T01:31:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11972024-11-08T01:31:21.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11982024-11-08T01:31:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11992024-11-08T01:31:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12002024-11-08T01:31:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12012024-11-08T01:31:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12022024-11-08T01:31:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
12032024-11-08T01:31:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12042024-11-08T01:31:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12052024-11-08T01:31:21.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
12062024-11-08T01:31:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.810527ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
12072024-11-08T01:31:21.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 793564dd-d9cf-4c6e-8fd1-559ef529cf81 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12082024-11-08T01:31:21.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 793564dd-d9cf-4c6e-8fd1-559ef529cf81 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12092024-11-08T01:31:21.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 793564dd-d9cf-4c6e-8fd1-559ef529cf81 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12102024-11-08T01:31:22.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5790aacc-f837-468d-812f-1132c8e6edbe roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12112024-11-08T01:31:22.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5790aacc-f837-468d-812f-1132c8e6edbe resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12122024-11-08T01:31:22.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5790aacc-f837-468d-812f-1132c8e6edbe response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12132024-11-08T01:31:23.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8af1748-5dae-43c4-a42b-c582e172dbcc roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12142024-11-08T01:31:23.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8af1748-5dae-43c4-a42b-c582e172dbcc resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12152024-11-08T01:31:23.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d8af1748-5dae-43c4-a42b-c582e172dbcc response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12162024-11-08T01:31:24.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99b2e1c-500b-4309-bd1a-256abdadb263 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12172024-11-08T01:31:24.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99b2e1c-500b-4309-bd1a-256abdadb263 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12182024-11-08T01:31:24.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99b2e1c-500b-4309-bd1a-256abdadb263 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12192024-11-08T01:31:24.861ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37235
12202024-11-08T01:31:24.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37235 req_id = 46fa0390-0b42-431d-a3c8-48788b4804f0 roles = RoleSet { roles: {} } uri = /metrics/producers
12212024-11-08T01:31:24.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37235 req_id = 46fa0390-0b42-431d-a3c8-48788b4804f0 resource = Database result = Ok(()) uri = /metrics/producers
12222024-11-08T01:31:24.900ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 861af0e9-1a8a-48bd-a8ed-6c14b35576c5
12232024-11-08T01:31:24.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38473 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37235 req_id = 46fa0390-0b42-431d-a3c8-48788b4804f0 response_code = 201 uri = /metrics/producers
12242024-11-08T01:31:24.989ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59856
12252024-11-08T01:31:24.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59856 req_id = 6388aa99-0c7b-4c47-9f52-2baa3d4ff4c0 roles = RoleSet { roles: {} } uri = /metrics/producers
12262024-11-08T01:31:24.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59856 req_id = 6388aa99-0c7b-4c47-9f52-2baa3d4ff4c0 resource = Database result = Ok(()) uri = /metrics/producers
12272024-11-08T01:31:25.031ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = ca74b71f-49fb-469a-9605-bfd58f47f205
12282024-11-08T01:31:25.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41616 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59856 req_id = 6388aa99-0c7b-4c47-9f52-2baa3d4ff4c0 response_code = 201 uri = /metrics/producers
12292024-11-08T01:31:25.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 341044ae-8638-41ab-9ea0-0bc83769f43c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12302024-11-08T01:31:25.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 341044ae-8638-41ab-9ea0-0bc83769f43c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12312024-11-08T01:31:25.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 341044ae-8638-41ab-9ea0-0bc83769f43c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12322024-11-08T01:31:26.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ad9bc5b-c2db-4d1b-9524-bcb6cedd2199 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12332024-11-08T01:31:26.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ad9bc5b-c2db-4d1b-9524-bcb6cedd2199 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12342024-11-08T01:31:26.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ad9bc5b-c2db-4d1b-9524-bcb6cedd2199 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12352024-11-08T01:31:26.659ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62792
12362024-11-08T01:31:26.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62792 req_id = 63a72dfb-fc4c-4dc8-86ec-279b49e182f5 roles = RoleSet { roles: {} } uri = /metrics/producers
12372024-11-08T01:31:26.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62792 req_id = 63a72dfb-fc4c-4dc8-86ec-279b49e182f5 resource = Database result = Ok(()) uri = /metrics/producers
12382024-11-08T01:31:26.698ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d
12392024-11-08T01:31:26.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38009 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62792 req_id = 63a72dfb-fc4c-4dc8-86ec-279b49e182f5 response_code = 201 uri = /metrics/producers
12402024-11-08T01:31:27.088ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53896
12412024-11-08T01:31:27.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53896 req_id = b39c193f-b924-40fa-a7ac-ebb7d505a559 roles = RoleSet { roles: {} } uri = /metrics/producers
12422024-11-08T01:31:27.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53896 req_id = b39c193f-b924-40fa-a7ac-ebb7d505a559 resource = Database result = Ok(()) uri = /metrics/producers
12432024-11-08T01:31:27.098ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = cb06a8fc-af98-4e26-90a6-5c333714c8a7
12442024-11-08T01:31:27.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9359 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53896 req_id = b39c193f-b924-40fa-a7ac-ebb7d505a559 response_code = 201 uri = /metrics/producers
12452024-11-08T01:31:27.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c0fa160-1810-47ad-9677-4e8ec380be0e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12462024-11-08T01:31:27.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c0fa160-1810-47ad-9677-4e8ec380be0e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12472024-11-08T01:31:27.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c0fa160-1810-47ad-9677-4e8ec380be0e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12482024-11-08T01:31:28.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 77d9d388-4877-439d-ae94-13216b77114c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12492024-11-08T01:31:28.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 77d9d388-4877-439d-ae94-13216b77114c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12502024-11-08T01:31:28.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 77d9d388-4877-439d-ae94-13216b77114c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12512024-11-08T01:31:29.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6f98d2e6-d3b2-474d-b43d-30a41d1dad20 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12522024-11-08T01:31:29.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6f98d2e6-d3b2-474d-b43d-30a41d1dad20 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12532024-11-08T01:31:29.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6f98d2e6-d3b2-474d-b43d-30a41d1dad20 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12542024-11-08T01:31:30.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1379 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = dad465cb-20a5-483b-89c9-2d7b48c42716 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
12552024-11-08T01:31:30.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f37c717-6c76-46b5-b0bc-70c5ee5bc324 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12562024-11-08T01:31:30.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f37c717-6c76-46b5-b0bc-70c5ee5bc324 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12572024-11-08T01:31:30.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f37c717-6c76-46b5-b0bc-70c5ee5bc324 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12582024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
12592024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
12602024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12612024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12622024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12632024-11-08T01:31:31.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12642024-11-08T01:31:31.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12652024-11-08T01:31:31.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12662024-11-08T01:31:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12672024-11-08T01:31:31.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.342154ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12682024-11-08T01:31:31.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12692024-11-08T01:31:31.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12702024-11-08T01:31:31.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12712024-11-08T01:31:31.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12722024-11-08T01:31:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12732024-11-08T01:31:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-11-08T01:31:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
12752024-11-08T01:31:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12762024-11-08T01:31:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772024-11-08T01:31:31.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
12782024-11-08T01:31:31.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.034223ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
12792024-11-08T01:31:31.353ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42136
12802024-11-08T01:31:31.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42136 req_id = bc18d0b6-ea3f-4e72-94bc-d7001dafda74 roles = RoleSet { roles: {} } uri = /metrics/producers
12812024-11-08T01:31:31.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42136 req_id = bc18d0b6-ea3f-4e72-94bc-d7001dafda74 resource = Database result = Ok(()) uri = /metrics/producers
12822024-11-08T01:31:31.362ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = f8b5c8d6-6ffd-4c5c-afa2-474a8cf9ea92
12832024-11-08T01:31:31.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8859 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42136 req_id = bc18d0b6-ea3f-4e72-94bc-d7001dafda74 response_code = 201 uri = /metrics/producers
12842024-11-08T01:31:31.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e1ebca3-a08e-4a51-ab80-7f5d1351272b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12852024-11-08T01:31:31.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e1ebca3-a08e-4a51-ab80-7f5d1351272b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12862024-11-08T01:31:31.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e1ebca3-a08e-4a51-ab80-7f5d1351272b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12872024-11-08T01:31:32.226ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53930
12882024-11-08T01:31:32.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53930 req_id = 2c957bd3-6cfd-4c30-a2a5-980d2dcb027f roles = RoleSet { roles: {} } uri = /metrics/producers
12892024-11-08T01:31:32.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53930 req_id = 2c957bd3-6cfd-4c30-a2a5-980d2dcb027f resource = Database result = Ok(()) uri = /metrics/producers
12902024-11-08T01:31:32.262ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = d7ca6535-bec2-4045-807b-1d2c3d385a99
12912024-11-08T01:31:32.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36074 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53930 req_id = 2c957bd3-6cfd-4c30-a2a5-980d2dcb027f response_code = 201 uri = /metrics/producers
12922024-11-08T01:31:32.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 688601c0-1b1c-49f4-8e54-b4861431ef6d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12932024-11-08T01:31:32.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 688601c0-1b1c-49f4-8e54-b4861431ef6d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12942024-11-08T01:31:32.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 688601c0-1b1c-49f4-8e54-b4861431ef6d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12952024-11-08T01:31:33.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9555b7a-ee59-41bb-8904-56c873fb3f8d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12962024-11-08T01:31:33.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9555b7a-ee59-41bb-8904-56c873fb3f8d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12972024-11-08T01:31:33.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9555b7a-ee59-41bb-8904-56c873fb3f8d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12982024-11-08T01:31:34.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1353fa9c-9cbd-41bb-bacc-1fe4b0bf14fe roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
12992024-11-08T01:31:34.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1353fa9c-9cbd-41bb-bacc-1fe4b0bf14fe resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13002024-11-08T01:31:34.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1353fa9c-9cbd-41bb-bacc-1fe4b0bf14fe response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13012024-11-08T01:31:35.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6e11efec-4fc3-4300-a84b-27257d6635a1 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
13022024-11-08T01:31:35.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6e11efec-4fc3-4300-a84b-27257d6635a1 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
13032024-11-08T01:31:35.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 6e11efec-4fc3-4300-a84b-27257d6635a1 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
13042024-11-08T01:31:35.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = f449787b-6356-479a-a0c8-631fdb0cf181 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
13052024-11-08T01:31:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = f449787b-6356-479a-a0c8-631fdb0cf181 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
13062024-11-08T01:31:35.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = f449787b-6356-479a-a0c8-631fdb0cf181 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
13072024-11-08T01:31:35.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42536280-2515-4c6c-9bdd-088b2b69a3fa roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13082024-11-08T01:31:35.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42536280-2515-4c6c-9bdd-088b2b69a3fa resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13092024-11-08T01:31:35.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42536280-2515-4c6c-9bdd-088b2b69a3fa response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13102024-11-08T01:31:36.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d14b6164-ee2b-40f4-b945-a5e9b05c6549 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13112024-11-08T01:31:36.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d14b6164-ee2b-40f4-b945-a5e9b05c6549 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13122024-11-08T01:31:36.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d14b6164-ee2b-40f4-b945-a5e9b05c6549 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13132024-11-08T01:31:37.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a06ca77f-9dd1-43eb-9eb1-8c032c58c051 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13142024-11-08T01:31:37.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a06ca77f-9dd1-43eb-9eb1-8c032c58c051 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13152024-11-08T01:31:37.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a06ca77f-9dd1-43eb-9eb1-8c032c58c051 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13162024-11-08T01:31:38.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5d248924-9bbd-4c77-8888-45ca9c3e4b7d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13172024-11-08T01:31:38.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5d248924-9bbd-4c77-8888-45ca9c3e4b7d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13182024-11-08T01:31:38.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5d248924-9bbd-4c77-8888-45ca9c3e4b7d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13192024-11-08T01:31:39.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66d61d9a-96c8-4785-809a-4cf25b062ef7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13202024-11-08T01:31:39.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66d61d9a-96c8-4785-809a-4cf25b062ef7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13212024-11-08T01:31:39.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66d61d9a-96c8-4785-809a-4cf25b062ef7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13222024-11-08T01:31:40.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6d9fc742-c01f-40f4-9c74-ee56b02729a3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13232024-11-08T01:31:40.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6d9fc742-c01f-40f4-9c74-ee56b02729a3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13242024-11-08T01:31:40.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6d9fc742-c01f-40f4-9c74-ee56b02729a3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
13252024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
13262024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
13272024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13282024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13292024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
13302024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13312024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13322024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
13332024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
13342024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13352024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
13362024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13372024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13382024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
13392024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.22\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13402024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
13412024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
13422024-11-08T01:31:41.274ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13432024-11-08T01:31:41.274ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
13442024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13452024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.35\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
13462024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
13472024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
13482024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13492024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13502024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
13512024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.72\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13522024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
13532024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
13542024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
13552024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
13562024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13572024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13582024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.89\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
13592024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
13602024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
13612024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
13622024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
13632024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13642024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13652024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
13662024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
13672024-11-08T01:31:41.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13682024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13692024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13702024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
13712024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
13722024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13732024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.54\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
13742024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
13752024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
13762024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13772024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13782024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13792024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
13802024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13812024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
13822024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
13832024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
13842024-11-08T01:31:41.274ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:21:41.274557698 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13852024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13862024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13872024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13882024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13892024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13902024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13912024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13922024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13932024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13942024-11-08T01:31:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13952024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13962024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13972024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13982024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13992024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14002024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14012024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14022024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14042024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14052024-11-08T01:31:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 486092175 } })
14062024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14072024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14082024-11-08T01:31:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 486132236 } })
14092024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14102024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.231056ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14112024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
14122024-11-08T01:31:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.305307ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
14132024-11-08T01:31:41.277ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.173563ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14142024-11-08T01:31:41.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-11-08T01:31:41.278ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14162024-11-08T01:31:41.278ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14172024-11-08T01:31:41.278ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14182024-11-08T01:31:41.278ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 489697644 } })
14192024-11-08T01:31:41.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14202024-11-08T01:31:41.278ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
14212024-11-08T01:31:41.279ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222024-11-08T01:31:41.280ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 491651920 } })
14232024-11-08T01:31:41.280ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
14242024-11-08T01:31:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14252024-11-08T01:31:41.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14262024-11-08T01:31:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14272024-11-08T01:31:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14282024-11-08T01:31:41.283ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14292024-11-08T01:31:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14302024-11-08T01:31:41.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14312024-11-08T01:31:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14322024-11-08T01:31:41.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14342024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14352024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14372024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14382024-11-08T01:31:41.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392024-11-08T01:31:41.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402024-11-08T01:31:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14412024-11-08T01:31:41.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14422024-11-08T01:31:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14432024-11-08T01:31:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14442024-11-08T01:31:41.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14452024-11-08T01:31:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14462024-11-08T01:31:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14472024-11-08T01:31:41.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14482024-11-08T01:31:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14492024-11-08T01:31:41.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14502024-11-08T01:31:41.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14512024-11-08T01:31:41.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14522024-11-08T01:31:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14532024-11-08T01:31:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14542024-11-08T01:31:41.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552024-11-08T01:31:41.294ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:21:41.274557698 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14562024-11-08T01:31:41.294ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.719715ms iteration = 9 status = {"expiration":"2024-11-08T01:21:41.274557698Z","pruned":[]}
14572024-11-08T01:31:41.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582024-11-08T01:31:41.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14592024-11-08T01:31:41.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14602024-11-08T01:31:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14612024-11-08T01:31:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.772103ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
14622024-11-08T01:31:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14632024-11-08T01:31:41.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14642024-11-08T01:31:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14652024-11-08T01:31:41.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14662024-11-08T01:31:41.302ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14672024-11-08T01:31:41.302ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14682024-11-08T01:31:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14692024-11-08T01:31:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14702024-11-08T01:31:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14712024-11-08T01:31:41.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14722024-11-08T01:31:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14732024-11-08T01:31:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 516550305 } })
14742024-11-08T01:31:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
14752024-11-08T01:31:41.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-11-08T01:31:41.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14772024-11-08T01:31:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14782024-11-08T01:31:41.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14792024-11-08T01:31:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14802024-11-08T01:31:41.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14812024-11-08T01:31:41.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14822024-11-08T01:31:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14832024-11-08T01:31:41.312ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14842024-11-08T01:31:41.312ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 37.729457ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14852024-11-08T01:31:41.349ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14862024-11-08T01:31:41.349ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14872024-11-08T01:31:41.349ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.675653ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14882024-11-08T01:31:41.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14892024-11-08T01:31:41.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14902024-11-08T01:31:41.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-11-08T01:31:41.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.508339ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14922024-11-08T01:31:41.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-11-08T01:31:41.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942024-11-08T01:31:41.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952024-11-08T01:31:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14962024-11-08T01:31:41.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14972024-11-08T01:31:41.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14982024-11-08T01:31:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14992024-11-08T01:31:41.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15002024-11-08T01:31:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15012024-11-08T01:31:41.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15022024-11-08T01:31:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15032024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15042024-11-08T01:31:41.361ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15052024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.893118ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15062024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15072024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15082024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15092024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15102024-11-08T01:31:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15112024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15122024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15132024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15142024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15152024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15162024-11-08T01:31:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15172024-11-08T01:31:41.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182024-11-08T01:31:41.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15192024-11-08T01:31:41.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-11-08T01:31:41.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15212024-11-08T01:31:41.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15222024-11-08T01:31:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15232024-11-08T01:31:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
15242024-11-08T01:31:41.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15252024-11-08T01:31:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15262024-11-08T01:31:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
15272024-11-08T01:31:41.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15282024-11-08T01:31:41.371ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15292024-11-08T01:31:41.371ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15302024-11-08T01:31:41.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.975623ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15312024-11-08T01:31:41.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15322024-11-08T01:31:41.374ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.115245ms iteration = 17 status = 0
15332024-11-08T01:31:41.376ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-11-08T01:31:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15352024-11-08T01:31:41.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15362024-11-08T01:31:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15372024-11-08T01:31:41.386ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
15382024-11-08T01:31:41.386ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.387931ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
15392024-11-08T01:31:41.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15402024-11-08T01:31:41.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15412024-11-08T01:31:41.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-11-08T01:31:41.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15432024-11-08T01:31:41.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15442024-11-08T01:31:41.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15452024-11-08T01:31:41.416ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15462024-11-08T01:31:41.416ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15472024-11-08T01:31:41.416ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15482024-11-08T01:31:41.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15492024-11-08T01:31:41.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15502024-11-08T01:31:41.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15512024-11-08T01:31:41.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15522024-11-08T01:31:41.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 155.694822ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15532024-11-08T01:31:41.447ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15542024-11-08T01:31:41.447ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15552024-11-08T01:31:41.447ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15562024-11-08T01:31:41.447ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "704b01ac-350d-4cab-86ad-ec059acbeffd", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
15572024-11-08T01:31:41.447ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15582024-11-08T01:31:41.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15592024-11-08T01:31:41.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15602024-11-08T01:31:41.461ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15612024-11-08T01:31:41.461ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15622024-11-08T01:31:41.462ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc583cd2-8993-45e8-8c71-78557e44324c", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
15632024-11-08T01:31:41.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15642024-11-08T01:31:41.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15652024-11-08T01:31:41.502ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.313069ms iteration = 20 status = {"physical_disks_added":0}
15662024-11-08T01:31:41.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
15672024-11-08T01:31:41.539ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15682024-11-08T01:31:41.539ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a9011d6-f006-4992-87d9-c51e4e91952c", "content-length": "26", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
15692024-11-08T01:31:41.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15702024-11-08T01:31:41.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
15712024-11-08T01:31:41.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15722024-11-08T01:31:41.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ad4adb7-ae3b-443a-ad7b-a5489e472d72", "content-length": "691", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
15732024-11-08T01:31:41.587ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15742024-11-08T01:31:41.587ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15752024-11-08T01:31:41.587ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15762024-11-08T01:31:41.588ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.435306ms iteration = 17 status = {}
15772024-11-08T01:31:41.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782024-11-08T01:31:41.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-11-08T01:31:41.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15802024-11-08T01:31:41.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15812024-11-08T01:31:41.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15822024-11-08T01:31:41.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15832024-11-08T01:31:41.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15842024-11-08T01:31:41.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15852024-11-08T01:31:41.616ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15862024-11-08T01:31:41.616ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
15872024-11-08T01:31:41.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15882024-11-08T01:31:41.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15892024-11-08T01:31:41.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-11-08T01:31:41.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15912024-11-08T01:31:41.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15922024-11-08T01:31:41.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15932024-11-08T01:31:41.625ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
15942024-11-08T01:31:41.625ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15952024-11-08T01:31:41.625ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
15962024-11-08T01:31:41.625ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 350.838515ms iteration = 10 status = {"generation":2}
15972024-11-08T01:31:41.632ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15982024-11-08T01:31:41.632ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15992024-11-08T01:31:41.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16002024-11-08T01:31:41.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16012024-11-08T01:31:41.637ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16022024-11-08T01:31:41.637ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) }
16032024-11-08T01:31:41.637ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.970179ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16042024-11-08T01:31:41.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16052024-11-08T01:31:41.655ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "66dc94da-e636-4c53-8808-04c41422e0cc", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16062024-11-08T01:31:41.655ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16072024-11-08T01:31:41.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ae831e93-c5bb-416a-b91b-133aec1cd73b", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16082024-11-08T01:31:41.656ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16092024-11-08T01:31:41.658ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16102024-11-08T01:31:41.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 384.405466ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16112024-11-08T01:31:41.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122024-11-08T01:31:41.671ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16132024-11-08T01:31:41.671ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16142024-11-08T01:31:41.671ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a025975e-2785-4aaf-b3fc-51fb35b24fe0", "content-length": "372", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
16152024-11-08T01:31:41.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16162024-11-08T01:31:41.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16172024-11-08T01:31:41.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16182024-11-08T01:31:41.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16192024-11-08T01:31:41.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16202024-11-08T01:31:41.675ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 401.163932ms iteration = 17 status = {}
16212024-11-08T01:31:41.676ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16222024-11-08T01:31:41.676ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16232024-11-08T01:31:41.676ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
16242024-11-08T01:31:41.676ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 401.75356ms iteration = 10 status = {"generation":1}
16252024-11-08T01:31:41.687ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16262024-11-08T01:31:41.687ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16272024-11-08T01:31:41.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "043706cc-a9b2-49a4-82d9-1412ddd03531", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
16282024-11-08T01:31:41.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292024-11-08T01:31:41.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16302024-11-08T01:31:41.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16312024-11-08T01:31:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16322024-11-08T01:31:41.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16332024-11-08T01:31:41.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16342024-11-08T01:31:41.696ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16352024-11-08T01:31:41.696ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16362024-11-08T01:31:41.699ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16372024-11-08T01:31:41.699ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 425.085484ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16382024-11-08T01:31:41.706ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16392024-11-08T01:31:41.706ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a2ee2eb-c47e-4875-a030-2fe9f5eeec6d", "content-length": "1", "date": "Fri, 08 Nov 2024 01:31:40 GMT"} })
16402024-11-08T01:31:41.708ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16412024-11-08T01:31:41.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16422024-11-08T01:31:41.710ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 436.421626ms iteration = 17 status = null
16432024-11-08T01:31:41.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16442024-11-08T01:31:41.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "23fa7a2c-422c-4436-be85-b874e6eefe30", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16452024-11-08T01:31:41.731ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16462024-11-08T01:31:41.732ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "78d3b1b0-ed9f-4a85-911c-fc6888a97062", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16472024-11-08T01:31:41.732ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16482024-11-08T01:31:41.734ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d812fdaf-2d54-426f-ba61-e796fe2a6f5f", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16492024-11-08T01:31:41.734ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16502024-11-08T01:31:41.735ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16512024-11-08T01:31:41.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 461.24123ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16522024-11-08T01:31:41.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16532024-11-08T01:31:41.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16542024-11-08T01:31:41.786ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
16552024-11-08T01:31:41.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16562024-11-08T01:31:41.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16572024-11-08T01:31:41.794ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f5e88065-6b9a-4beb-a2c2-ffcc05669db3", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
16582024-11-08T01:31:41.795ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 521.440539ms iteration = 18 status = {}
16592024-11-08T01:31:41.796ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16602024-11-08T01:31:41.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6fde1b3-626f-4a89-8484-df14f364ffee", "content-length": "134", "date": "Fri, 08 Nov 2024 01:31:40 GMT"} })
16612024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16622024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
16632024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16642024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16652024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16662024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16672024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16682024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16692024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16702024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16712024-11-08T01:31:41.797ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
16722024-11-08T01:31:41.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16732024-11-08T01:31:41.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16742024-11-08T01:31:41.800ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16752024-11-08T01:31:41.800ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ddca0f8-ed84-4e88-91e4-2a88e0a415d4", "content-length": "2", "date": "Fri, 08 Nov 2024 01:31:40 GMT"} })
16762024-11-08T01:31:41.800ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16772024-11-08T01:31:41.800ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "82c5ad2d-fb0f-4af8-b2f1-0aaeddadf6b8", "content-length": "52", "date": "Fri, 08 Nov 2024 01:31:40 GMT"} })
16782024-11-08T01:31:41.800ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
16792024-11-08T01:31:41.800ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16802024-11-08T01:31:41.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2accb082-4e28-485b-86b6-2abfdb50e36c", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
16812024-11-08T01:31:41.899ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
16822024-11-08T01:31:41.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16832024-11-08T01:31:41.899ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a37304cd-56c8-4b00-b3d2-53624b1443e5", "content-length": "682", "date": "Fri, 08 Nov 2024 01:31:41 GMT"} })
16842024-11-08T01:31:41.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16852024-11-08T01:31:41.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16862024-11-08T01:31:41.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16872024-11-08T01:31:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16882024-11-08T01:31:41.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16892024-11-08T01:31:41.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16902024-11-08T01:31:41.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16912024-11-08T01:31:41.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16922024-11-08T01:31:41.919ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.331594ms iteration = 17 status = {}
16932024-11-08T01:31:41.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 840cd545-4a0c-4d21-89ab-ba10195f5ecb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16942024-11-08T01:31:41.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 840cd545-4a0c-4d21-89ab-ba10195f5ecb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16952024-11-08T01:31:41.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 840cd545-4a0c-4d21-89ab-ba10195f5ecb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16962024-11-08T01:31:42.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 497d0dce-419d-4c35-859c-3693f5661987 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
16972024-11-08T01:31:42.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 497d0dce-419d-4c35-859c-3693f5661987 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
16982024-11-08T01:31:42.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 497d0dce-419d-4c35-859c-3693f5661987 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
16992024-11-08T01:31:43.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bae55ee-095e-48bb-85cf-fc7236c59978 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17002024-11-08T01:31:43.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bae55ee-095e-48bb-85cf-fc7236c59978 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17012024-11-08T01:31:43.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bae55ee-095e-48bb-85cf-fc7236c59978 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17022024-11-08T01:31:44.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abd560e3-b16f-4e7f-b640-229337e38f54 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17032024-11-08T01:31:44.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abd560e3-b16f-4e7f-b640-229337e38f54 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17042024-11-08T01:31:44.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = abd560e3-b16f-4e7f-b640-229337e38f54 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17052024-11-08T01:31:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1397 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 86248408-e18f-4207-9892-09e1a24d6d58 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
17062024-11-08T01:31:45.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8f607ee9-aae3-4116-8fe5-5260373d586f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17072024-11-08T01:31:45.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8f607ee9-aae3-4116-8fe5-5260373d586f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17082024-11-08T01:31:45.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8f607ee9-aae3-4116-8fe5-5260373d586f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17092024-11-08T01:31:46.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 667aff09-4d24-41e4-90e5-cfcbf6c2d2c0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17102024-11-08T01:31:46.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 667aff09-4d24-41e4-90e5-cfcbf6c2d2c0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17112024-11-08T01:31:46.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 667aff09-4d24-41e4-90e5-cfcbf6c2d2c0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17122024-11-08T01:31:47.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2cb612f-939d-4e2a-b23a-8c38090f6d1a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17132024-11-08T01:31:47.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2cb612f-939d-4e2a-b23a-8c38090f6d1a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17142024-11-08T01:31:47.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2cb612f-939d-4e2a-b23a-8c38090f6d1a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17152024-11-08T01:31:48.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7515124e-2a5f-4778-89ca-a37c167c58d3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17162024-11-08T01:31:48.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7515124e-2a5f-4778-89ca-a37c167c58d3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17172024-11-08T01:31:48.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7515124e-2a5f-4778-89ca-a37c167c58d3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17182024-11-08T01:31:49.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4a50d3a-1baf-4172-98c1-aa108a6e6943 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17192024-11-08T01:31:49.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4a50d3a-1baf-4172-98c1-aa108a6e6943 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17202024-11-08T01:31:49.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4a50d3a-1baf-4172-98c1-aa108a6e6943 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17212024-11-08T01:31:50.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 06789b21-a98d-4f28-99a9-b7621b219695 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17222024-11-08T01:31:50.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 06789b21-a98d-4f28-99a9-b7621b219695 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17232024-11-08T01:31:50.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 06789b21-a98d-4f28-99a9-b7621b219695 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17242024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
17252024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
17262024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17272024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17282024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17292024-11-08T01:31:51.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17302024-11-08T01:31:51.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9852650b-1c9c-427e-b3a7-b3985766202c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17312024-11-08T01:31:51.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9852650b-1c9c-427e-b3a7-b3985766202c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17322024-11-08T01:31:51.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9852650b-1c9c-427e-b3a7-b3985766202c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17332024-11-08T01:31:51.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342024-11-08T01:31:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17352024-11-08T01:31:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17362024-11-08T01:31:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17372024-11-08T01:31:51.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-11-08T01:31:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-11-08T01:31:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17402024-11-08T01:31:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17412024-11-08T01:31:51.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17422024-11-08T01:31:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
17432024-11-08T01:31:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17442024-11-08T01:31:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17452024-11-08T01:31:51.320ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
17462024-11-08T01:31:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.828349ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
17472024-11-08T01:31:51.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.886805ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17482024-11-08T01:31:52.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6dbad153-46d2-4482-9139-496dd8ed75be roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17492024-11-08T01:31:52.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6dbad153-46d2-4482-9139-496dd8ed75be resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17502024-11-08T01:31:52.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6dbad153-46d2-4482-9139-496dd8ed75be response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17512024-11-08T01:31:53.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 76f35b58-a2d3-4d22-99bf-42caa2571795 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17522024-11-08T01:31:53.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 76f35b58-a2d3-4d22-99bf-42caa2571795 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17532024-11-08T01:31:53.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 76f35b58-a2d3-4d22-99bf-42caa2571795 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17542024-11-08T01:31:53.653ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
17552024-11-08T01:31:53.653ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
17562024-11-08T01:31:53.684ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
17572024-11-08T01:31:53.684ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44497
17582024-11-08T01:31:53.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44497 req_id = f80ce523-975f-4275-a439-2a0cb6a40b8d roles = RoleSet { roles: {} } uri = /metrics/producers
17592024-11-08T01:31:53.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44497 req_id = f80ce523-975f-4275-a439-2a0cb6a40b8d resource = Database result = Ok(()) uri = /metrics/producers
17602024-11-08T01:31:53.723ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
17612024-11-08T01:31:53.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38852 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44497 req_id = f80ce523-975f-4275-a439-2a0cb6a40b8d response_code = 201 uri = /metrics/producers
17622024-11-08T01:31:53.723ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f80ce523-975f-4275-a439-2a0cb6a40b8d", "content-length": "41", "date": "Fri, 08 Nov 2024 01:31:53 GMT"} })
17632024-11-08T01:31:53.726ZDEBGnexus (producer-registration-task): registered with nexus successfully
17642024-11-08T01:31:53.726ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
17652024-11-08T01:31:54.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28689fd8-b8b1-4c9c-a719-9249db034c1c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17662024-11-08T01:31:54.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28689fd8-b8b1-4c9c-a719-9249db034c1c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17672024-11-08T01:31:54.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28689fd8-b8b1-4c9c-a719-9249db034c1c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17682024-11-08T01:31:55.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0170f272-af0a-4e0b-bdf0-2d16ebf31293 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17692024-11-08T01:31:55.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0170f272-af0a-4e0b-bdf0-2d16ebf31293 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17702024-11-08T01:31:55.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0170f272-af0a-4e0b-bdf0-2d16ebf31293 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17712024-11-08T01:31:56.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4337248e-ed11-43ea-989c-d1b5622744e5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17722024-11-08T01:31:56.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4337248e-ed11-43ea-989c-d1b5622744e5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17732024-11-08T01:31:56.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4337248e-ed11-43ea-989c-d1b5622744e5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17742024-11-08T01:31:57.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df354fe7-9363-4909-ab42-6239a0e6fc7a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17752024-11-08T01:31:57.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df354fe7-9363-4909-ab42-6239a0e6fc7a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17762024-11-08T01:31:57.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df354fe7-9363-4909-ab42-6239a0e6fc7a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17772024-11-08T01:31:58.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b68a0f5d-f57c-48a8-909c-dc4a422b56ce roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17782024-11-08T01:31:58.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b68a0f5d-f57c-48a8-909c-dc4a422b56ce resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17792024-11-08T01:31:58.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b68a0f5d-f57c-48a8-909c-dc4a422b56ce response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17802024-11-08T01:31:59.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d64a5ba-18b2-4728-9d33-77ca5793db11 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17812024-11-08T01:31:59.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d64a5ba-18b2-4728-9d33-77ca5793db11 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17822024-11-08T01:31:59.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7d64a5ba-18b2-4728-9d33-77ca5793db11 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17832024-11-08T01:32:00.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1493 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 3276dc85-0bf8-4501-a9b9-61b5a290677b response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
17842024-11-08T01:32:00.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fc5bbdc-50b0-43f4-9c8c-961f63b2d20c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17852024-11-08T01:32:00.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fc5bbdc-50b0-43f4-9c8c-961f63b2d20c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17862024-11-08T01:32:00.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fc5bbdc-50b0-43f4-9c8c-961f63b2d20c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
17872024-11-08T01:32:01.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
17882024-11-08T01:32:01.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
17892024-11-08T01:32:01.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17902024-11-08T01:32:01.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17912024-11-08T01:32:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922024-11-08T01:32:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17932024-11-08T01:32:01.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-11-08T01:32:01.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17952024-11-08T01:32:01.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17962024-11-08T01:32:01.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.158006ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17972024-11-08T01:32:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17982024-11-08T01:32:01.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17992024-11-08T01:32:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18002024-11-08T01:32:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18012024-11-08T01:32:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18022024-11-08T01:32:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032024-11-08T01:32:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
18042024-11-08T01:32:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18052024-11-08T01:32:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062024-11-08T01:32:01.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
18072024-11-08T01:32:01.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.959701ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
18082024-11-08T01:32:01.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c92db47-4663-489c-9153-a6b74e34dd60 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18092024-11-08T01:32:01.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c92db47-4663-489c-9153-a6b74e34dd60 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18102024-11-08T01:32:01.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c92db47-4663-489c-9153-a6b74e34dd60 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18112024-11-08T01:32:02.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = baaa3dda-2e61-4340-8a64-c44cf8e1d834 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18122024-11-08T01:32:02.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = baaa3dda-2e61-4340-8a64-c44cf8e1d834 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18132024-11-08T01:32:02.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = baaa3dda-2e61-4340-8a64-c44cf8e1d834 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18142024-11-08T01:32:03.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 221d909a-f981-4723-b0fd-24b09b64bf6b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18152024-11-08T01:32:03.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 221d909a-f981-4723-b0fd-24b09b64bf6b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18162024-11-08T01:32:03.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 221d909a-f981-4723-b0fd-24b09b64bf6b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18172024-11-08T01:32:04.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aad41f7-6b80-430f-93ec-055c3d54000a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18182024-11-08T01:32:04.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aad41f7-6b80-430f-93ec-055c3d54000a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18192024-11-08T01:32:04.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aad41f7-6b80-430f-93ec-055c3d54000a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18202024-11-08T01:32:05.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6dbb57c-4d52-461a-a7c0-a023b8e3c42f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18212024-11-08T01:32:05.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6dbb57c-4d52-461a-a7c0-a023b8e3c42f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18222024-11-08T01:32:05.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6dbb57c-4d52-461a-a7c0-a023b8e3c42f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18232024-11-08T01:32:06.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9f69c6c8-eb5d-4cd1-8b54-d236888e047c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18242024-11-08T01:32:06.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9f69c6c8-eb5d-4cd1-8b54-d236888e047c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18252024-11-08T01:32:06.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9f69c6c8-eb5d-4cd1-8b54-d236888e047c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18262024-11-08T01:32:07.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64201c5e-1cbe-4dd0-8fae-b36a2825361a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18272024-11-08T01:32:07.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64201c5e-1cbe-4dd0-8fae-b36a2825361a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18282024-11-08T01:32:07.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64201c5e-1cbe-4dd0-8fae-b36a2825361a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18292024-11-08T01:32:08.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 384ca4a4-f110-4f0b-b560-c0ca9e9886ed roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18302024-11-08T01:32:08.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 384ca4a4-f110-4f0b-b560-c0ca9e9886ed resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18312024-11-08T01:32:08.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 384ca4a4-f110-4f0b-b560-c0ca9e9886ed response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18322024-11-08T01:32:09.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc84e3fc-a0aa-4e97-b31e-9b7818582df1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18332024-11-08T01:32:09.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc84e3fc-a0aa-4e97-b31e-9b7818582df1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18342024-11-08T01:32:09.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc84e3fc-a0aa-4e97-b31e-9b7818582df1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18352024-11-08T01:32:10.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 480fb550-fc06-469a-8d19-2379f2c59815 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18362024-11-08T01:32:10.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 480fb550-fc06-469a-8d19-2379f2c59815 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18372024-11-08T01:32:10.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 480fb550-fc06-469a-8d19-2379f2c59815 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
18382024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
18392024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
18402024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18412024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18422024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
18432024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18442024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
18452024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
18462024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18472024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18482024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
18492024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18502024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
18512024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
18522024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18532024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18542024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
18552024-11-08T01:32:11.273ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18562024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
18572024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
18582024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.74\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18592024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18602024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.95\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
18612024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
18622024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
18632024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
18642024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18652024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18662024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18672024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
18682024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18692024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
18702024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.05\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
18712024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
18722024-11-08T01:32:11.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.851\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18732024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18742024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18752024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18762024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18772024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18782024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18792024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18802024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18812024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18822024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18832024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18842024-11-08T01:32:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18852024-11-08T01:32:11.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18862024-11-08T01:32:11.277ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 488419267 } })
18872024-11-08T01:32:11.277ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
18882024-11-08T01:32:11.278ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.564732ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18892024-11-08T01:32:11.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902024-11-08T01:32:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18912024-11-08T01:32:11.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18922024-11-08T01:32:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18932024-11-08T01:32:11.279ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 490666587 } })
18942024-11-08T01:32:11.280ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
18952024-11-08T01:32:11.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-11-08T01:32:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18972024-11-08T01:32:11.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18982024-11-08T01:32:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18992024-11-08T01:32:11.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-11-08T01:32:11.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19012024-11-08T01:32:11.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19022024-11-08T01:32:11.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-11-08T01:32:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19042024-11-08T01:32:11.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19052024-11-08T01:32:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19062024-11-08T01:32:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19072024-11-08T01:32:11.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19082024-11-08T01:32:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19092024-11-08T01:32:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19102024-11-08T01:32:11.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19112024-11-08T01:32:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19122024-11-08T01:32:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19132024-11-08T01:32:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19142024-11-08T01:32:11.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152024-11-08T01:32:11.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19162024-11-08T01:32:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19172024-11-08T01:32:11.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19182024-11-08T01:32:11.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19192024-11-08T01:32:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19202024-11-08T01:32:11.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-11-08T01:32:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19222024-11-08T01:32:11.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19232024-11-08T01:32:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19242024-11-08T01:32:11.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 528212442 } })
19252024-11-08T01:32:11.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
19262024-11-08T01:32:11.320ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19272024-11-08T01:32:11.320ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19282024-11-08T01:32:11.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19292024-11-08T01:32:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19302024-11-08T01:32:11.322ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19312024-11-08T01:32:11.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-11-08T01:32:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19332024-11-08T01:32:11.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19342024-11-08T01:32:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19352024-11-08T01:32:11.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19362024-11-08T01:32:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19372024-11-08T01:32:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
19382024-11-08T01:32:11.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19392024-11-08T01:32:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19402024-11-08T01:32:11.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19412024-11-08T01:32:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19422024-11-08T01:32:11.328ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19432024-11-08T01:32:11.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.387371ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19442024-11-08T01:32:11.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19452024-11-08T01:32:11.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19462024-11-08T01:32:11.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19472024-11-08T01:32:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
19482024-11-08T01:32:11.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19492024-11-08T01:32:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19502024-11-08T01:32:11.336ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.620221ms iteration = 18 status = 0
19512024-11-08T01:32:11.339ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19522024-11-08T01:32:11.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19532024-11-08T01:32:11.339ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
19542024-11-08T01:32:11.339ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.21624ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
19552024-11-08T01:32:11.350ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19562024-11-08T01:32:11.350ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19572024-11-08T01:32:11.351ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ca91334-2cb8-450f-9412-3885ac7eeff6", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19582024-11-08T01:32:11.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19592024-11-08T01:32:11.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19602024-11-08T01:32:11.368ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19612024-11-08T01:32:11.368ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19622024-11-08T01:32:11.368ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19632024-11-08T01:32:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19642024-11-08T01:32:11.375ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19652024-11-08T01:32:11.375ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19662024-11-08T01:32:11.375ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbd78368-cf55-4c9f-874a-c249bade94df", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19672024-11-08T01:32:11.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19682024-11-08T01:32:11.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19692024-11-08T01:32:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 105.335205ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19702024-11-08T01:32:11.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.913234ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19712024-11-08T01:32:11.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19722024-11-08T01:32:11.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19732024-11-08T01:32:11.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.35412ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19742024-11-08T01:32:11.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19752024-11-08T01:32:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19762024-11-08T01:32:11.437ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
19772024-11-08T01:32:11.437ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19782024-11-08T01:32:11.437ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a38998-c445-424a-b07c-fb078ece9bb4", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19792024-11-08T01:32:11.437ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19802024-11-08T01:32:11.439ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
19812024-11-08T01:32:11.456ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.959579ms iteration = 18 status = {}
19822024-11-08T01:32:11.458ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.693232ms iteration = 21 status = {"physical_disks_added":0}
19832024-11-08T01:32:11.486ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19842024-11-08T01:32:11.487ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5dac2cf-fd38-4dc8-8fc7-16378c49798f", "content-length": "1", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19852024-11-08T01:32:11.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19862024-11-08T01:32:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19872024-11-08T01:32:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.674776ms iteration = 18 status = null
19882024-11-08T01:32:11.518ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19892024-11-08T01:32:11.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19902024-11-08T01:32:11.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "baec9d90-bbc0-4c6b-a0b8-7c5dffa5aa9d", "content-length": "372", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19912024-11-08T01:32:11.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19922024-11-08T01:32:11.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19932024-11-08T01:32:11.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19942024-11-08T01:32:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19952024-11-08T01:32:11.535ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19962024-11-08T01:32:11.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19972024-11-08T01:32:11.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19982024-11-08T01:32:11.536ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cf493fae-c878-407c-b19b-ab9433ea8091", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
19992024-11-08T01:32:11.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20002024-11-08T01:32:11.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20012024-11-08T01:32:11.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20022024-11-08T01:32:11.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20032024-11-08T01:32:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20042024-11-08T01:32:11.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20052024-11-08T01:32:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20062024-11-08T01:32:11.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20072024-11-08T01:32:11.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20082024-11-08T01:32:11.544ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20092024-11-08T01:32:11.544ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20102024-11-08T01:32:11.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20112024-11-08T01:32:11.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20122024-11-08T01:32:11.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20132024-11-08T01:32:11.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20142024-11-08T01:32:11.635ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20152024-11-08T01:32:11.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20162024-11-08T01:32:11.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20172024-11-08T01:32:11.639ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
20182024-11-08T01:32:11.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20192024-11-08T01:32:11.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20202024-11-08T01:32:11.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "478fa759-1cc9-40a4-81d0-37644965de45", "content-length": "691", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20212024-11-08T01:32:11.645ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20222024-11-08T01:32:11.645ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20232024-11-08T01:32:11.645ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20242024-11-08T01:32:11.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f5492b67-b4ca-43c2-9058-392745a5be6c", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20252024-11-08T01:32:11.647ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 373.174116ms iteration = 18 status = {}
20262024-11-08T01:32:11.647ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 373.801504ms iteration = 19 status = {}
20272024-11-08T01:32:11.649ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20282024-11-08T01:32:11.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "829dbaf1-69f4-429d-aef8-8acd92fadfea", "content-length": "134", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20292024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20302024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
20312024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20322024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20332024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20342024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20352024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20362024-11-08T01:32:11.649ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20372024-11-08T01:32:11.650ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20382024-11-08T01:32:11.650ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20392024-11-08T01:32:11.650ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
20402024-11-08T01:32:11.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20412024-11-08T01:32:11.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20422024-11-08T01:32:11.652ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20432024-11-08T01:32:11.652ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "962afff3-cf63-407f-89fa-391dc8406294", "content-length": "2", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20442024-11-08T01:32:11.652ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20452024-11-08T01:32:11.652ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a539ad4c-737e-4f7f-a38d-fdbed278dc9e", "content-length": "52", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20462024-11-08T01:32:11.652ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
20472024-11-08T01:32:11.652ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20482024-11-08T01:32:11.751ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2986c10a-2a4c-4960-9306-0784ae9520c3", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20492024-11-08T01:32:11.751ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
20502024-11-08T01:32:11.751ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20512024-11-08T01:32:11.752ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e02a1bb-b3e9-4b5f-9bce-24b9cd453ea8", "content-length": "682", "date": "Fri, 08 Nov 2024 01:32:11 GMT"} })
20522024-11-08T01:32:11.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20532024-11-08T01:32:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20542024-11-08T01:32:11.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20552024-11-08T01:32:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20562024-11-08T01:32:11.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20572024-11-08T01:32:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20582024-11-08T01:32:11.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20592024-11-08T01:32:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20602024-11-08T01:32:11.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d56486e5-d62e-4199-85a1-0866b56ed61f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20612024-11-08T01:32:11.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d56486e5-d62e-4199-85a1-0866b56ed61f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20622024-11-08T01:32:11.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d56486e5-d62e-4199-85a1-0866b56ed61f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20632024-11-08T01:32:11.769ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.033637ms iteration = 18 status = {}
20642024-11-08T01:32:11.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b370f9dc-75d5-447d-8bea-07a418097a1d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
20652024-11-08T01:32:11.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b370f9dc-75d5-447d-8bea-07a418097a1d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
20662024-11-08T01:32:11.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b370f9dc-75d5-447d-8bea-07a418097a1d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
20672024-11-08T01:32:12.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 80e4d851-305d-4c1f-85ea-eb92699f916e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20682024-11-08T01:32:12.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 80e4d851-305d-4c1f-85ea-eb92699f916e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20692024-11-08T01:32:12.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 80e4d851-305d-4c1f-85ea-eb92699f916e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20702024-11-08T01:32:13.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe82c8c-142b-4cd9-8c27-ead71645e1ff roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20712024-11-08T01:32:13.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe82c8c-142b-4cd9-8c27-ead71645e1ff resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20722024-11-08T01:32:13.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe82c8c-142b-4cd9-8c27-ead71645e1ff response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20732024-11-08T01:32:14.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 040be89f-77ff-4eee-a4c9-78920e0be8ab roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20742024-11-08T01:32:14.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 040be89f-77ff-4eee-a4c9-78920e0be8ab resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20752024-11-08T01:32:14.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 040be89f-77ff-4eee-a4c9-78920e0be8ab response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20762024-11-08T01:32:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = c13f7a47-19b9-4d50-91e6-4bf9195650cd response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
20772024-11-08T01:32:15.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5b066e8c-05b8-456b-aa01-b6c9fa056f6a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20782024-11-08T01:32:15.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5b066e8c-05b8-456b-aa01-b6c9fa056f6a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20792024-11-08T01:32:15.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5b066e8c-05b8-456b-aa01-b6c9fa056f6a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20802024-11-08T01:32:16.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2f88815-ced9-47be-ae0a-fbe86f6b9291 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20812024-11-08T01:32:16.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2f88815-ced9-47be-ae0a-fbe86f6b9291 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20822024-11-08T01:32:16.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e2f88815-ced9-47be-ae0a-fbe86f6b9291 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20832024-11-08T01:32:17.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 450794b2-3dee-43b9-9cd4-e1706a316c9d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20842024-11-08T01:32:17.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 450794b2-3dee-43b9-9cd4-e1706a316c9d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20852024-11-08T01:32:17.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 450794b2-3dee-43b9-9cd4-e1706a316c9d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20862024-11-08T01:32:18.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a37ce16-4bed-4d5d-8028-270494e8b8bb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20872024-11-08T01:32:18.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a37ce16-4bed-4d5d-8028-270494e8b8bb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20882024-11-08T01:32:18.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a37ce16-4bed-4d5d-8028-270494e8b8bb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20892024-11-08T01:32:19.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 000609d2-9da4-4a81-85e6-e9c813a24131 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20902024-11-08T01:32:19.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 000609d2-9da4-4a81-85e6-e9c813a24131 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20912024-11-08T01:32:19.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 000609d2-9da4-4a81-85e6-e9c813a24131 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20922024-11-08T01:32:20.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 22591089-bf1c-41bd-ac20-2f241669b6e2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20932024-11-08T01:32:20.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 22591089-bf1c-41bd-ac20-2f241669b6e2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20942024-11-08T01:32:20.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 22591089-bf1c-41bd-ac20-2f241669b6e2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
20952024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
20962024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
20972024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20982024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20992024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21002024-11-08T01:32:21.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21012024-11-08T01:32:21.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21022024-11-08T01:32:21.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21032024-11-08T01:32:21.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21042024-11-08T01:32:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21052024-11-08T01:32:21.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21062024-11-08T01:32:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21072024-11-08T01:32:21.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21082024-11-08T01:32:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21092024-11-08T01:32:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21102024-11-08T01:32:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
21112024-11-08T01:32:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21122024-11-08T01:32:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21132024-11-08T01:32:21.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
21142024-11-08T01:32:21.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.514012ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
21152024-11-08T01:32:21.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.776594ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21162024-11-08T01:32:22.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4ddf343a-d734-410f-99bb-c949c78bef00 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21172024-11-08T01:32:22.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4ddf343a-d734-410f-99bb-c949c78bef00 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21182024-11-08T01:32:22.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4ddf343a-d734-410f-99bb-c949c78bef00 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21192024-11-08T01:32:23.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 32e41a17-8485-4541-9508-990d1e643f22 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21202024-11-08T01:32:23.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 32e41a17-8485-4541-9508-990d1e643f22 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21212024-11-08T01:32:23.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 32e41a17-8485-4541-9508-990d1e643f22 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21222024-11-08T01:32:24.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a977a531-d85f-4b76-84f5-c97f785cf858 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21232024-11-08T01:32:24.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a977a531-d85f-4b76-84f5-c97f785cf858 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21242024-11-08T01:32:24.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a977a531-d85f-4b76-84f5-c97f785cf858 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21252024-11-08T01:32:25.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 668bfcfb-327e-4986-9203-5637dc4f3012 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21262024-11-08T01:32:25.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 668bfcfb-327e-4986-9203-5637dc4f3012 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21272024-11-08T01:32:25.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 668bfcfb-327e-4986-9203-5637dc4f3012 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21282024-11-08T01:32:26.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66bd43ec-b97d-4427-a6ce-2d8a651eda76 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21292024-11-08T01:32:26.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66bd43ec-b97d-4427-a6ce-2d8a651eda76 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21302024-11-08T01:32:26.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 66bd43ec-b97d-4427-a6ce-2d8a651eda76 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21312024-11-08T01:32:27.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53c2ffe-6341-4cae-a9db-6260d8875984 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21322024-11-08T01:32:27.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53c2ffe-6341-4cae-a9db-6260d8875984 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21332024-11-08T01:32:27.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53c2ffe-6341-4cae-a9db-6260d8875984 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21342024-11-08T01:32:28.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c157f251-22a7-4b0e-a425-76cb34d1b23d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21352024-11-08T01:32:28.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c157f251-22a7-4b0e-a425-76cb34d1b23d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21362024-11-08T01:32:28.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c157f251-22a7-4b0e-a425-76cb34d1b23d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21372024-11-08T01:32:29.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bee1f6c-bb81-4f4e-ae07-3f4d43c5f0be roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21382024-11-08T01:32:29.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bee1f6c-bb81-4f4e-ae07-3f4d43c5f0be resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21392024-11-08T01:32:29.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bee1f6c-bb81-4f4e-ae07-3f4d43c5f0be response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21402024-11-08T01:32:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1531 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 473606d9-0d8f-4114-997a-0a87cb74aac9 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
21412024-11-08T01:32:30.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 284dbfd2-ef79-4604-a074-7f2f4c6afd5b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21422024-11-08T01:32:30.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 284dbfd2-ef79-4604-a074-7f2f4c6afd5b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21432024-11-08T01:32:30.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 284dbfd2-ef79-4604-a074-7f2f4c6afd5b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21442024-11-08T01:32:31.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4e145007-b1a1-4d62-87d8-031356f689b0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21452024-11-08T01:32:31.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4e145007-b1a1-4d62-87d8-031356f689b0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21462024-11-08T01:32:31.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4e145007-b1a1-4d62-87d8-031356f689b0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21472024-11-08T01:32:31.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
21482024-11-08T01:32:31.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
21492024-11-08T01:32:31.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21502024-11-08T01:32:31.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21512024-11-08T01:32:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21522024-11-08T01:32:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21532024-11-08T01:32:31.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21542024-11-08T01:32:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21552024-11-08T01:32:31.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562024-11-08T01:32:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21572024-11-08T01:32:31.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582024-11-08T01:32:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592024-11-08T01:32:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21602024-11-08T01:32:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21612024-11-08T01:32:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21622024-11-08T01:32:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
21632024-11-08T01:32:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21642024-11-08T01:32:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21652024-11-08T01:32:31.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
21662024-11-08T01:32:31.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.56128ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
21672024-11-08T01:32:31.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.107675ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21682024-11-08T01:32:32.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 976f91ed-ea74-4a2c-b239-fedef6061df7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21692024-11-08T01:32:32.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 976f91ed-ea74-4a2c-b239-fedef6061df7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21702024-11-08T01:32:32.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 976f91ed-ea74-4a2c-b239-fedef6061df7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21712024-11-08T01:32:33.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc4b1af8-210f-449c-85aa-794f9c45f4f9 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21722024-11-08T01:32:33.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc4b1af8-210f-449c-85aa-794f9c45f4f9 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21732024-11-08T01:32:33.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fc4b1af8-210f-449c-85aa-794f9c45f4f9 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21742024-11-08T01:32:34.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 34a9d30e-dcf7-4791-8fcb-8f9f07db283a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21752024-11-08T01:32:34.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 34a9d30e-dcf7-4791-8fcb-8f9f07db283a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21762024-11-08T01:32:34.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 34a9d30e-dcf7-4791-8fcb-8f9f07db283a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21772024-11-08T01:32:35.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f530fd-e4fb-4571-9bff-11cd4f912e4c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21782024-11-08T01:32:35.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f530fd-e4fb-4571-9bff-11cd4f912e4c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21792024-11-08T01:32:35.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f530fd-e4fb-4571-9bff-11cd4f912e4c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21802024-11-08T01:32:36.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6587f99-77b7-41bd-836c-f95e2bf2db33 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21812024-11-08T01:32:36.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6587f99-77b7-41bd-836c-f95e2bf2db33 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21822024-11-08T01:32:36.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d6587f99-77b7-41bd-836c-f95e2bf2db33 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21832024-11-08T01:32:37.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c414886d-554b-4adb-8c25-d2994a9d550f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21842024-11-08T01:32:37.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c414886d-554b-4adb-8c25-d2994a9d550f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21852024-11-08T01:32:37.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c414886d-554b-4adb-8c25-d2994a9d550f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21862024-11-08T01:32:38.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ca972a6-9a58-4dbd-9207-e76c55f006db roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21872024-11-08T01:32:38.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ca972a6-9a58-4dbd-9207-e76c55f006db resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21882024-11-08T01:32:38.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ca972a6-9a58-4dbd-9207-e76c55f006db response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21892024-11-08T01:32:39.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 974311cc-c73c-407b-85a8-bf90d8e20c1f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21902024-11-08T01:32:39.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 974311cc-c73c-407b-85a8-bf90d8e20c1f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21912024-11-08T01:32:39.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 974311cc-c73c-407b-85a8-bf90d8e20c1f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21922024-11-08T01:32:40.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 12a3afe7-5eb2-47cf-9138-bd1ae7ce10a4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21932024-11-08T01:32:40.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 12a3afe7-5eb2-47cf-9138-bd1ae7ce10a4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21942024-11-08T01:32:40.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 12a3afe7-5eb2-47cf-9138-bd1ae7ce10a4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
21952024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
21962024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
21972024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21982024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21992024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
22002024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
22012024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22022024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22032024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22042024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
22052024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22062024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
22072024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22082024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
22092024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
22102024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
22112024-11-08T01:32:41.274ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:22:41.274310130 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22122024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.911\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22132024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22142024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
22152024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
22162024-11-08T01:32:41.274ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
22172024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.31\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
22182024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
22192024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.63\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
22202024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
22212024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
22222024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
22232024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22242024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22252024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22262024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
22272024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
22282024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22292024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
22302024-11-08T01:32:41.274ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22312024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22322024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22332024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
22342024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.04\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22352024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
22362024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
22372024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22382024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.041\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
22392024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
22402024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22412024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
22422024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
22432024-11-08T01:32:41.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22442024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22462024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
22472024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
22482024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22492024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22502024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22512024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
22522024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
22532024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22542024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
22552024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
22562024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
22572024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22582024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22592024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22602024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22612024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22622024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22632024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22642024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22652024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22662024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22672024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22682024-11-08T01:32:41.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22692024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22702024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22712024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22722024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22732024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22742024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22752024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22762024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22772024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22782024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22792024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22802024-11-08T01:32:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 485785061 } })
22812024-11-08T01:32:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 485807892 } })
22822024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22832024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22842024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22852024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22862024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22872024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
22882024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.355868ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
22892024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22902024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22912024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
22922024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.359458ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
22932024-11-08T01:32:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22942024-11-08T01:32:41.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22952024-11-08T01:32:41.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-11-08T01:32:41.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972024-11-08T01:32:41.277ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.158093ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22982024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22992024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23002024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23012024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23022024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23032024-11-08T01:32:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23042024-11-08T01:32:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23052024-11-08T01:32:41.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23062024-11-08T01:32:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23072024-11-08T01:32:41.281ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:22:41.274310130 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23082024-11-08T01:32:41.281ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.44277ms iteration = 10 status = {"expiration":"2024-11-08T01:22:41.274310130Z","pruned":[]}
23092024-11-08T01:32:41.281ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.530832ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
23102024-11-08T01:32:41.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23112024-11-08T01:32:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23122024-11-08T01:32:41.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 493964881 } })
23132024-11-08T01:32:41.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 494177554 } })
23142024-11-08T01:32:41.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
23152024-11-08T01:32:41.283ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23162024-11-08T01:32:41.283ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23172024-11-08T01:32:41.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23182024-11-08T01:32:41.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
23192024-11-08T01:32:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23202024-11-08T01:32:41.284ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23212024-11-08T01:32:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23222024-11-08T01:32:41.286ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23232024-11-08T01:32:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23242024-11-08T01:32:41.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23252024-11-08T01:32:41.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23262024-11-08T01:32:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23272024-11-08T01:32:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23282024-11-08T01:32:41.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292024-11-08T01:32:41.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23302024-11-08T01:32:41.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23312024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23322024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23332024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23342024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23352024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23362024-11-08T01:32:41.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23372024-11-08T01:32:41.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23382024-11-08T01:32:41.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23392024-11-08T01:32:41.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23402024-11-08T01:32:41.297ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23412024-11-08T01:32:41.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23422024-11-08T01:32:41.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23432024-11-08T01:32:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23442024-11-08T01:32:41.298ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 508895572 } })
23452024-11-08T01:32:41.298ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
23462024-11-08T01:32:41.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472024-11-08T01:32:41.300ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23482024-11-08T01:32:41.300ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23492024-11-08T01:32:41.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23502024-11-08T01:32:41.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.917409ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23512024-11-08T01:32:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23522024-11-08T01:32:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23532024-11-08T01:32:41.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23542024-11-08T01:32:41.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23552024-11-08T01:32:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23562024-11-08T01:32:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23572024-11-08T01:32:41.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23582024-11-08T01:32:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23592024-11-08T01:32:41.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-11-08T01:32:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
23612024-11-08T01:32:41.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23622024-11-08T01:32:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23632024-11-08T01:32:41.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642024-11-08T01:32:41.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652024-11-08T01:32:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23662024-11-08T01:32:41.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23672024-11-08T01:32:41.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
23682024-11-08T01:32:41.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.591197ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
23692024-11-08T01:32:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23702024-11-08T01:32:41.327ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23712024-11-08T01:32:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23722024-11-08T01:32:41.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23732024-11-08T01:32:41.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23742024-11-08T01:32:41.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23752024-11-08T01:32:41.332ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23762024-11-08T01:32:41.332ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23772024-11-08T01:32:41.332ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.237553ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23782024-11-08T01:32:41.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23792024-11-08T01:32:41.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23802024-11-08T01:32:41.339ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812024-11-08T01:32:41.339ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822024-11-08T01:32:41.339ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23832024-11-08T01:32:41.339ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23842024-11-08T01:32:41.339ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 65.557751ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23852024-11-08T01:32:41.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23862024-11-08T01:32:41.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23872024-11-08T01:32:41.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23882024-11-08T01:32:41.343ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23892024-11-08T01:32:41.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23902024-11-08T01:32:41.343ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-11-08T01:32:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23922024-11-08T01:32:41.344ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23932024-11-08T01:32:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23942024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23952024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23962024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23972024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23992024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24002024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24012024-11-08T01:32:41.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24022024-11-08T01:32:41.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24032024-11-08T01:32:41.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24042024-11-08T01:32:41.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24052024-11-08T01:32:41.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24062024-11-08T01:32:41.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24072024-11-08T01:32:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24082024-11-08T01:32:41.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24092024-11-08T01:32:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24102024-11-08T01:32:41.354ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24112024-11-08T01:32:41.354ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.912154ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24122024-11-08T01:32:41.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24132024-11-08T01:32:41.364ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 90.363595ms iteration = 5 status = {"nsuccess":5}
24142024-11-08T01:32:41.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24152024-11-08T01:32:41.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24162024-11-08T01:32:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24172024-11-08T01:32:41.369ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24182024-11-08T01:32:41.369ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24192024-11-08T01:32:41.369ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.658766ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24202024-11-08T01:32:41.370ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.232903ms iteration = 22 status = {"physical_disks_added":0}
24212024-11-08T01:32:41.382ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24222024-11-08T01:32:41.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24232024-11-08T01:32:41.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24242024-11-08T01:32:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24252024-11-08T01:32:41.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24262024-11-08T01:32:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24272024-11-08T01:32:41.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24282024-11-08T01:32:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
24292024-11-08T01:32:41.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24302024-11-08T01:32:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24312024-11-08T01:32:41.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322024-11-08T01:32:41.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24332024-11-08T01:32:41.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24342024-11-08T01:32:41.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24352024-11-08T01:32:41.411ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.391437ms iteration = 19 status = 0
24362024-11-08T01:32:41.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 144.388831ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24372024-11-08T01:32:41.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24382024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24392024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24402024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24412024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24422024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24432024-11-08T01:32:41.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24442024-11-08T01:32:41.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-11-08T01:32:41.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24462024-11-08T01:32:41.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24472024-11-08T01:32:41.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24482024-11-08T01:32:41.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24492024-11-08T01:32:41.429ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
24502024-11-08T01:32:41.429ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24512024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24522024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
24532024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24542024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24552024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24562024-11-08T01:32:41.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24572024-11-08T01:32:41.430ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65b7bf81-d3e9-4800-88da-a702b6ef3b81", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
24582024-11-08T01:32:41.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24592024-11-08T01:32:41.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24602024-11-08T01:32:41.438ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
24612024-11-08T01:32:41.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622024-11-08T01:32:41.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24632024-11-08T01:32:41.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24642024-11-08T01:32:41.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24652024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24662024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
24672024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24682024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
24692024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.166702ms iteration = 11 status = {"generation":2}
24702024-11-08T01:32:41.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24712024-11-08T01:32:41.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 13c5aec9-729f-4ace-baf4-a741fbe87929 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
24722024-11-08T01:32:41.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 13c5aec9-729f-4ace-baf4-a741fbe87929 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
24732024-11-08T01:32:41.460ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
24742024-11-08T01:32:41.460ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24752024-11-08T01:32:41.461ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a7d6fdd-3162-4d96-a547-43cd6c062a80", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
24762024-11-08T01:32:41.461ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24772024-11-08T01:32:41.468ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24782024-11-08T01:32:41.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 13c5aec9-729f-4ace-baf4-a741fbe87929 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
24792024-11-08T01:32:41.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
24802024-11-08T01:32:41.486ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24812024-11-08T01:32:41.487ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8de51c1-fb24-4b65-a58e-af40ee4b5a89", "content-length": "26", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
24822024-11-08T01:32:41.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24832024-11-08T01:32:41.489ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24842024-11-08T01:32:41.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24852024-11-08T01:32:41.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24862024-11-08T01:32:41.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24872024-11-08T01:32:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24882024-11-08T01:32:41.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892024-11-08T01:32:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24902024-11-08T01:32:41.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24912024-11-08T01:32:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24922024-11-08T01:32:41.508ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) }
24932024-11-08T01:32:41.508ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 234.645383ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24942024-11-08T01:32:41.509ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24952024-11-08T01:32:41.509ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24962024-11-08T01:32:41.509ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
24972024-11-08T01:32:41.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 235.529265ms iteration = 11 status = {"generation":1}
24982024-11-08T01:32:41.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24992024-11-08T01:32:41.561ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25002024-11-08T01:32:41.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 286.851455ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25012024-11-08T01:32:41.618ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25022024-11-08T01:32:41.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25032024-11-08T01:32:41.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25042024-11-08T01:32:41.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-11-08T01:32:41.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25062024-11-08T01:32:41.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25072024-11-08T01:32:41.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25082024-11-08T01:32:41.652ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.979041ms iteration = 19 status = {}
25092024-11-08T01:32:41.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25102024-11-08T01:32:41.757ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "350d3abe-9b6b-4e96-b148-1c2de844f1d1", "content-length": "1", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25112024-11-08T01:32:41.758ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25122024-11-08T01:32:41.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25132024-11-08T01:32:41.789ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25142024-11-08T01:32:41.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25152024-11-08T01:32:41.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162024-11-08T01:32:41.792ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.204125ms iteration = 19 status = null
25172024-11-08T01:32:41.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25182024-11-08T01:32:41.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25192024-11-08T01:32:41.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25202024-11-08T01:32:41.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25212024-11-08T01:32:41.845ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ad4fdb-670a-448e-9a5d-149166fee35f", "content-length": "372", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25222024-11-08T01:32:41.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25232024-11-08T01:32:41.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25242024-11-08T01:32:41.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25252024-11-08T01:32:41.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25262024-11-08T01:32:41.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6a7e3bf5-5c05-4201-8e63-07ae227ff846", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25272024-11-08T01:32:41.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25282024-11-08T01:32:41.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25292024-11-08T01:32:41.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25302024-11-08T01:32:41.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25312024-11-08T01:32:41.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25322024-11-08T01:32:41.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25332024-11-08T01:32:41.867ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25342024-11-08T01:32:41.867ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25352024-11-08T01:32:41.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "49c894b1-e378-4158-b777-3e6f62bbb4a2", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25362024-11-08T01:32:41.870ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 595.668596ms iteration = 20 status = {}
25372024-11-08T01:32:41.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25382024-11-08T01:32:41.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25392024-11-08T01:32:41.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25402024-11-08T01:32:41.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9c89c987-d58e-4315-bf3f-861df4fff72d", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25412024-11-08T01:32:41.874ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25422024-11-08T01:32:41.876ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa5c127a-34d4-4a33-bd9f-a9477493c500", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25432024-11-08T01:32:41.876ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25442024-11-08T01:32:41.878ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25452024-11-08T01:32:41.878ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 604.019519ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25462024-11-08T01:32:41.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25472024-11-08T01:32:41.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f07b248-7f27-4a62-b6a1-a3e6cf70a0ff", "content-length": "691", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25482024-11-08T01:32:41.927ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25492024-11-08T01:32:41.928ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25502024-11-08T01:32:41.928ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25512024-11-08T01:32:41.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25522024-11-08T01:32:41.929ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 655.594552ms iteration = 19 status = {}
25532024-11-08T01:32:41.930ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "05204342-2d51-4cd0-b26c-8782faf449f9", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25542024-11-08T01:32:41.930ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25552024-11-08T01:32:41.930ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
25562024-11-08T01:32:41.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25572024-11-08T01:32:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25582024-11-08T01:32:41.931ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bcf24341-f5f7-4dba-a413-1eb42e519ed2", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25592024-11-08T01:32:41.931ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25602024-11-08T01:32:41.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6956df01-e1b0-486e-a2ce-c50f6d7ad854", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25612024-11-08T01:32:41.933ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25622024-11-08T01:32:41.934ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
25632024-11-08T01:32:41.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 660.420416ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25642024-11-08T01:32:41.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25652024-11-08T01:32:41.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c883622c-1f26-4ed4-841f-c9dc0adcb35b", "content-length": "134", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25662024-11-08T01:32:41.937ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25672024-11-08T01:32:41.937ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
25682024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25692024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25702024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25712024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25722024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25732024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25742024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25752024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25762024-11-08T01:32:41.938ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
25772024-11-08T01:32:41.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25782024-11-08T01:32:41.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25792024-11-08T01:32:41.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25802024-11-08T01:32:41.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d72f2fa6-99a7-40f9-8c6e-e17a7c8f2042", "content-length": "2", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25812024-11-08T01:32:41.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25822024-11-08T01:32:41.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ada15e01-6615-49c7-bc85-e33060515ec5", "content-length": "52", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25832024-11-08T01:32:41.940ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
25842024-11-08T01:32:41.940ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25852024-11-08T01:32:42.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 3e3cd019-9dce-4f86-bcef-0bf4308b88b5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25862024-11-08T01:32:42.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 3e3cd019-9dce-4f86-bcef-0bf4308b88b5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25872024-11-08T01:32:42.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 3e3cd019-9dce-4f86-bcef-0bf4308b88b5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25882024-11-08T01:32:42.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "88049868-b7d0-4266-b733-82fb0ccb4c21", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25892024-11-08T01:32:42.042ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
25902024-11-08T01:32:42.042ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25912024-11-08T01:32:42.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "62dee87b-6b68-481b-8b2c-1c13041d0ed9", "content-length": "682", "date": "Fri, 08 Nov 2024 01:32:41 GMT"} })
25922024-11-08T01:32:42.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25932024-11-08T01:32:42.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25942024-11-08T01:32:42.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25952024-11-08T01:32:42.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25962024-11-08T01:32:42.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972024-11-08T01:32:42.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982024-11-08T01:32:42.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25992024-11-08T01:32:42.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26002024-11-08T01:32:42.060ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 786.055384ms iteration = 19 status = {}
26012024-11-08T01:32:42.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d4e7d8d2-e6c7-4a7c-b841-b6f71cb01ff6 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26022024-11-08T01:32:42.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d4e7d8d2-e6c7-4a7c-b841-b6f71cb01ff6 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26032024-11-08T01:32:42.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d4e7d8d2-e6c7-4a7c-b841-b6f71cb01ff6 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26042024-11-08T01:32:43.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9dd0663b-3693-4d74-90af-b15a969e0497 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26052024-11-08T01:32:43.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9dd0663b-3693-4d74-90af-b15a969e0497 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26062024-11-08T01:32:43.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9dd0663b-3693-4d74-90af-b15a969e0497 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26072024-11-08T01:32:44.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3e2e4ee-66a1-449e-917e-863268eb0029 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26082024-11-08T01:32:44.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3e2e4ee-66a1-449e-917e-863268eb0029 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26092024-11-08T01:32:44.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3e2e4ee-66a1-449e-917e-863268eb0029 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26102024-11-08T01:32:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1300 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = d523a1ca-af80-4ff5-b57f-71168615636c response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
26112024-11-08T01:32:45.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37bca2e7-8c07-4f4d-9818-213d3d24f51d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26122024-11-08T01:32:45.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37bca2e7-8c07-4f4d-9818-213d3d24f51d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26132024-11-08T01:32:45.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37bca2e7-8c07-4f4d-9818-213d3d24f51d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26142024-11-08T01:32:46.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb7ad94d-ce3b-4fc8-b308-8a3e3f50082c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26152024-11-08T01:32:46.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb7ad94d-ce3b-4fc8-b308-8a3e3f50082c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26162024-11-08T01:32:46.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bb7ad94d-ce3b-4fc8-b308-8a3e3f50082c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26172024-11-08T01:32:47.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1dbc6cc7-3cf8-4992-8a36-28291dcb963d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26182024-11-08T01:32:47.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1dbc6cc7-3cf8-4992-8a36-28291dcb963d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26192024-11-08T01:32:47.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1dbc6cc7-3cf8-4992-8a36-28291dcb963d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26202024-11-08T01:32:48.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 487abdd0-184d-4f95-8754-47b89d907ad3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26212024-11-08T01:32:48.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 487abdd0-184d-4f95-8754-47b89d907ad3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26222024-11-08T01:32:48.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 487abdd0-184d-4f95-8754-47b89d907ad3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26232024-11-08T01:32:49.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9e16af-9617-48fe-93e2-168eceb02db1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26242024-11-08T01:32:49.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9e16af-9617-48fe-93e2-168eceb02db1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26252024-11-08T01:32:49.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9e16af-9617-48fe-93e2-168eceb02db1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26262024-11-08T01:32:50.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c7a80481-4063-4b37-b4d1-d7e0c0a45151 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26272024-11-08T01:32:50.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c7a80481-4063-4b37-b4d1-d7e0c0a45151 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26282024-11-08T01:32:50.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c7a80481-4063-4b37-b4d1-d7e0c0a45151 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26292024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
26302024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
26312024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26322024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26332024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26342024-11-08T01:32:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26352024-11-08T01:32:51.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362024-11-08T01:32:51.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26372024-11-08T01:32:51.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26382024-11-08T01:32:51.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.107415ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26392024-11-08T01:32:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26402024-11-08T01:32:51.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26412024-11-08T01:32:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26422024-11-08T01:32:51.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26432024-11-08T01:32:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26442024-11-08T01:32:51.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452024-11-08T01:32:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
26462024-11-08T01:32:51.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26472024-11-08T01:32:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26482024-11-08T01:32:51.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
26492024-11-08T01:32:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.472796ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
26502024-11-08T01:32:51.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ee4fc5b0-80b5-470c-8d45-0a2db7331eda roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26512024-11-08T01:32:51.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ee4fc5b0-80b5-470c-8d45-0a2db7331eda resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26522024-11-08T01:32:51.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ee4fc5b0-80b5-470c-8d45-0a2db7331eda response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26532024-11-08T01:32:52.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 579878a3-dd10-4316-9c2c-cfdc1393fc5f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26542024-11-08T01:32:52.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 579878a3-dd10-4316-9c2c-cfdc1393fc5f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26552024-11-08T01:32:52.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 579878a3-dd10-4316-9c2c-cfdc1393fc5f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26562024-11-08T01:32:53.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 015b2b40-ca82-48a4-ab30-9930a45daa91 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26572024-11-08T01:32:53.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 015b2b40-ca82-48a4-ab30-9930a45daa91 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26582024-11-08T01:32:53.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 015b2b40-ca82-48a4-ab30-9930a45daa91 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26592024-11-08T01:32:54.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2457a1da-f3c2-4520-95ec-bc519a365a6a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26602024-11-08T01:32:54.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2457a1da-f3c2-4520-95ec-bc519a365a6a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26612024-11-08T01:32:54.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2457a1da-f3c2-4520-95ec-bc519a365a6a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26622024-11-08T01:32:55.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf3508b9-6e71-4ec5-9599-5be1892ec362 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26632024-11-08T01:32:55.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf3508b9-6e71-4ec5-9599-5be1892ec362 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26642024-11-08T01:32:55.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf3508b9-6e71-4ec5-9599-5be1892ec362 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26652024-11-08T01:32:56.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 31702d35-a488-4763-afb3-0bbb0b1a5d43 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26662024-11-08T01:32:56.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 31702d35-a488-4763-afb3-0bbb0b1a5d43 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26672024-11-08T01:32:56.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 31702d35-a488-4763-afb3-0bbb0b1a5d43 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26682024-11-08T01:32:57.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3262093-cfc7-483d-9194-ac96c2884e1e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26692024-11-08T01:32:57.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3262093-cfc7-483d-9194-ac96c2884e1e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26702024-11-08T01:32:57.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b3262093-cfc7-483d-9194-ac96c2884e1e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26712024-11-08T01:32:58.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9a279e85-e88b-4ee8-aace-48b60ed3f13f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26722024-11-08T01:32:58.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9a279e85-e88b-4ee8-aace-48b60ed3f13f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26732024-11-08T01:32:58.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9a279e85-e88b-4ee8-aace-48b60ed3f13f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26742024-11-08T01:32:59.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 555f4f08-8745-4131-90bd-e55eedd2346f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26752024-11-08T01:32:59.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 555f4f08-8745-4131-90bd-e55eedd2346f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26762024-11-08T01:32:59.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 555f4f08-8745-4131-90bd-e55eedd2346f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26772024-11-08T01:33:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = a782ea6e-5c5f-4679-9246-a358cfa892d6 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
26782024-11-08T01:33:00.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2a5409ee-fa02-470a-8f7d-4e5e208cb2aa roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26792024-11-08T01:33:00.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2a5409ee-fa02-470a-8f7d-4e5e208cb2aa resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26802024-11-08T01:33:00.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2a5409ee-fa02-470a-8f7d-4e5e208cb2aa response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
26812024-11-08T01:33:01.273ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
26822024-11-08T01:33:01.273ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
26832024-11-08T01:33:01.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26842024-11-08T01:33:01.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26852024-11-08T01:33:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26862024-11-08T01:33:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26872024-11-08T01:33:01.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882024-11-08T01:33:01.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26892024-11-08T01:33:01.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26902024-11-08T01:33:01.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.47291ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26912024-11-08T01:33:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26922024-11-08T01:33:01.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26932024-11-08T01:33:01.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26942024-11-08T01:33:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26952024-11-08T01:33:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26962024-11-08T01:33:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26972024-11-08T01:33:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
26982024-11-08T01:33:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26992024-11-08T01:33:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27002024-11-08T01:33:01.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
27012024-11-08T01:33:01.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.279096ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
27022024-11-08T01:33:01.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7e7084f-ce67-4202-8abe-5e560b2c624f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27032024-11-08T01:33:01.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7e7084f-ce67-4202-8abe-5e560b2c624f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27042024-11-08T01:33:01.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7e7084f-ce67-4202-8abe-5e560b2c624f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27052024-11-08T01:33:02.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8532b4da-0d10-4b21-9d94-d79126399bad roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27062024-11-08T01:33:02.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8532b4da-0d10-4b21-9d94-d79126399bad resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27072024-11-08T01:33:02.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8532b4da-0d10-4b21-9d94-d79126399bad response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27082024-11-08T01:33:03.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ddfbeb86-ba42-48da-b291-f62ee87756f5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27092024-11-08T01:33:03.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ddfbeb86-ba42-48da-b291-f62ee87756f5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27102024-11-08T01:33:03.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ddfbeb86-ba42-48da-b291-f62ee87756f5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27112024-11-08T01:33:05.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53143a1-cfa0-44ed-948e-867130ae005a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27122024-11-08T01:33:05.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53143a1-cfa0-44ed-948e-867130ae005a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27132024-11-08T01:33:05.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b53143a1-cfa0-44ed-948e-867130ae005a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27142024-11-08T01:33:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = a2ca02f3-94c5-44d1-bc93-029e151f96d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
27152024-11-08T01:33:05.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = a2ca02f3-94c5-44d1-bc93-029e151f96d8 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
27162024-11-08T01:33:05.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = a2ca02f3-94c5-44d1-bc93-029e151f96d8 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
27172024-11-08T01:33:05.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 4956f616-a642-4241-9a9f-7728077d2c89 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
27182024-11-08T01:33:05.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 4956f616-a642-4241-9a9f-7728077d2c89 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
27192024-11-08T01:33:05.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 4956f616-a642-4241-9a9f-7728077d2c89 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
27202024-11-08T01:33:06.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dac9a2b5-4d14-4afd-b7e3-fdeb4687ab66 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27212024-11-08T01:33:06.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dac9a2b5-4d14-4afd-b7e3-fdeb4687ab66 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27222024-11-08T01:33:06.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dac9a2b5-4d14-4afd-b7e3-fdeb4687ab66 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27232024-11-08T01:33:07.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ae62d4bb-3419-42f7-b9f3-2f6369efc689 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27242024-11-08T01:33:07.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ae62d4bb-3419-42f7-b9f3-2f6369efc689 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27252024-11-08T01:33:07.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ae62d4bb-3419-42f7-b9f3-2f6369efc689 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27262024-11-08T01:33:08.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fabddd3-2974-477f-b500-c8b9a5f7ab0b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27272024-11-08T01:33:08.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fabddd3-2974-477f-b500-c8b9a5f7ab0b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27282024-11-08T01:33:08.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fabddd3-2974-477f-b500-c8b9a5f7ab0b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27292024-11-08T01:33:09.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ff49de39-2370-422c-8cda-2d6c28a315a8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27302024-11-08T01:33:09.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ff49de39-2370-422c-8cda-2d6c28a315a8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27312024-11-08T01:33:09.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ff49de39-2370-422c-8cda-2d6c28a315a8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27322024-11-08T01:33:10.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba23e346-ce0e-4597-b1d9-82f3ae26532f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27332024-11-08T01:33:10.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba23e346-ce0e-4597-b1d9-82f3ae26532f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27342024-11-08T01:33:10.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba23e346-ce0e-4597-b1d9-82f3ae26532f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27352024-11-08T01:33:11.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2ae46d19-c0ab-4819-8305-0b1f81076b7d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27362024-11-08T01:33:11.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2ae46d19-c0ab-4819-8305-0b1f81076b7d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27372024-11-08T01:33:11.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2ae46d19-c0ab-4819-8305-0b1f81076b7d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
27382024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
27392024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
27402024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.17\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
27412024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
27422024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27432024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
27442024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.6\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
27452024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
27462024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.971\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27472024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
27482024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.22\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27492024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
27502024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27512024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
27522024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
27532024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27542024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
27552024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27562024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27572024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
27582024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
27592024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27602024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27612024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
27622024-11-08T01:33:11.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27632024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27642024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
27652024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
27662024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27672024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27682024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
27692024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27702024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
27712024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27722024-11-08T01:33:11.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27732024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27742024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27752024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27762024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27772024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27782024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27792024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27802024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27812024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27822024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27832024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27842024-11-08T01:33:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27852024-11-08T01:33:11.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27862024-11-08T01:33:11.277ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872024-11-08T01:33:11.278ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.910062ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27882024-11-08T01:33:11.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27892024-11-08T01:33:11.278ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 489290348 } })
27902024-11-08T01:33:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27912024-11-08T01:33:11.279ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
27922024-11-08T01:33:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27932024-11-08T01:33:11.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27942024-11-08T01:33:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27952024-11-08T01:33:11.280ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27962024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27972024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27982024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27992024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28002024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28012024-11-08T01:33:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28022024-11-08T01:33:11.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28032024-11-08T01:33:11.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042024-11-08T01:33:11.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 493704488 } })
28052024-11-08T01:33:11.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062024-11-08T01:33:11.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
28072024-11-08T01:33:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28082024-11-08T01:33:11.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28092024-11-08T01:33:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28102024-11-08T01:33:11.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-11-08T01:33:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28122024-11-08T01:33:11.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28132024-11-08T01:33:11.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.575136ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28142024-11-08T01:33:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28152024-11-08T01:33:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28162024-11-08T01:33:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28172024-11-08T01:33:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28182024-11-08T01:33:11.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28192024-11-08T01:33:11.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28202024-11-08T01:33:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28212024-11-08T01:33:11.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28222024-11-08T01:33:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28232024-11-08T01:33:11.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28242024-11-08T01:33:11.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28252024-11-08T01:33:11.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28262024-11-08T01:33:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272024-11-08T01:33:11.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28282024-11-08T01:33:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28292024-11-08T01:33:11.291ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 501931778 } })
28302024-11-08T01:33:11.291ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
28312024-11-08T01:33:11.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28322024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28332024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28342024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28352024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28362024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28372024-11-08T01:33:11.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28382024-11-08T01:33:11.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
28392024-11-08T01:33:11.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28402024-11-08T01:33:11.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28412024-11-08T01:33:11.308ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
28422024-11-08T01:33:11.308ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.069018ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
28432024-11-08T01:33:11.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28442024-11-08T01:33:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28452024-11-08T01:33:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28462024-11-08T01:33:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28472024-11-08T01:33:11.322ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28482024-11-08T01:33:11.322ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28492024-11-08T01:33:11.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28502024-11-08T01:33:11.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28512024-11-08T01:33:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28522024-11-08T01:33:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28532024-11-08T01:33:11.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.03409ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28542024-11-08T01:33:11.323ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28552024-11-08T01:33:11.323ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.245222ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28562024-11-08T01:33:11.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28572024-11-08T01:33:11.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
28582024-11-08T01:33:11.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28592024-11-08T01:33:11.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28602024-11-08T01:33:11.329ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.229143ms iteration = 20 status = 0
28612024-11-08T01:33:11.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
28622024-11-08T01:33:11.370ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28632024-11-08T01:33:11.370ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4daf0ae5-7cce-4f23-8824-9b0e47c2a9c7", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
28642024-11-08T01:33:11.370ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28652024-11-08T01:33:11.371ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28662024-11-08T01:33:11.371ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28672024-11-08T01:33:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.108835ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28682024-11-08T01:33:11.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28692024-11-08T01:33:11.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
28702024-11-08T01:33:11.385ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28712024-11-08T01:33:11.386ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72f89ae7-62d0-4bc6-a6a7-95c068e099b5", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
28722024-11-08T01:33:11.386ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28732024-11-08T01:33:11.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28742024-11-08T01:33:11.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
28752024-11-08T01:33:11.399ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28762024-11-08T01:33:11.399ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f8745e0-e2e6-4a07-9a15-951b11915879", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
28772024-11-08T01:33:11.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28782024-11-08T01:33:11.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
28792024-11-08T01:33:11.415ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.476702ms iteration = 23 status = {"physical_disks_added":0}
28802024-11-08T01:33:11.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28812024-11-08T01:33:11.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28822024-11-08T01:33:11.456ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28832024-11-08T01:33:11.456ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "75419373-905d-409e-a9f8-5db6bfa29fe7", "content-length": "1", "date": "Fri, 08 Nov 2024 01:33:10 GMT"} })
28842024-11-08T01:33:11.458ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28852024-11-08T01:33:11.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28862024-11-08T01:33:11.460ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28872024-11-08T01:33:11.460ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28882024-11-08T01:33:11.460ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "57d85880-80a2-4a7b-987f-bdd2d283caea", "content-length": "372", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
28892024-11-08T01:33:11.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28902024-11-08T01:33:11.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28912024-11-08T01:33:11.461ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 186.672799ms iteration = 20 status = null
28922024-11-08T01:33:11.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28932024-11-08T01:33:11.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28942024-11-08T01:33:11.469ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.479244ms iteration = 20 status = {}
28952024-11-08T01:33:11.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28962024-11-08T01:33:11.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28972024-11-08T01:33:11.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28982024-11-08T01:33:11.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28992024-11-08T01:33:11.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29002024-11-08T01:33:11.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29012024-11-08T01:33:11.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29022024-11-08T01:33:11.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29032024-11-08T01:33:11.501ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29042024-11-08T01:33:11.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29052024-11-08T01:33:11.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3addfeab-4841-44b4-bf5b-40bb8a3d4427", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
29062024-11-08T01:33:11.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29072024-11-08T01:33:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29082024-11-08T01:33:11.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29092024-11-08T01:33:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29102024-11-08T01:33:11.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29112024-11-08T01:33:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29122024-11-08T01:33:11.510ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29132024-11-08T01:33:11.510ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29142024-11-08T01:33:11.511ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b783dd2c-729e-4aa1-91f3-6cc9d95cb8fb", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
29152024-11-08T01:33:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.226692ms iteration = 21 status = {}
29162024-11-08T01:33:11.608ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29172024-11-08T01:33:11.628ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5a519f-f315-406b-bb8d-bffd5743be93", "content-length": "691", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
29182024-11-08T01:33:11.628ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29192024-11-08T01:33:11.628ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29202024-11-08T01:33:11.628ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29212024-11-08T01:33:11.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29222024-11-08T01:33:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29232024-11-08T01:33:11.630ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 355.997525ms iteration = 20 status = {}
29242024-11-08T01:33:11.632ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
29252024-11-08T01:33:11.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29262024-11-08T01:33:11.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29272024-11-08T01:33:11.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29282024-11-08T01:33:11.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aeddc6f-6d8b-4e7b-b02d-85f938726ccb", "content-length": "134", "date": "Fri, 08 Nov 2024 01:33:10 GMT"} })
29292024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29302024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
29312024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29322024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29332024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29342024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29352024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29362024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29372024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29382024-11-08T01:33:11.641ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29392024-11-08T01:33:11.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
29402024-11-08T01:33:11.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29412024-11-08T01:33:11.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29422024-11-08T01:33:11.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29432024-11-08T01:33:11.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "780112e5-ecab-4678-b39e-78745bd44c88", "content-length": "2", "date": "Fri, 08 Nov 2024 01:33:10 GMT"} })
29442024-11-08T01:33:11.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29452024-11-08T01:33:11.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fda5d295-4ba3-421e-88bd-93fd486fafcf", "content-length": "52", "date": "Fri, 08 Nov 2024 01:33:10 GMT"} })
29462024-11-08T01:33:11.644ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
29472024-11-08T01:33:11.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29482024-11-08T01:33:11.750ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "be395c38-1fa4-47e9-aaa2-7c44c8b2ea98", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
29492024-11-08T01:33:11.750ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
29502024-11-08T01:33:11.750ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29512024-11-08T01:33:11.750ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "adac8694-6ec9-47a0-af1d-2c7274df4897", "content-length": "682", "date": "Fri, 08 Nov 2024 01:33:11 GMT"} })
29522024-11-08T01:33:11.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29532024-11-08T01:33:11.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29542024-11-08T01:33:11.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29552024-11-08T01:33:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29562024-11-08T01:33:11.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29572024-11-08T01:33:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29582024-11-08T01:33:11.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29592024-11-08T01:33:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29602024-11-08T01:33:11.765ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.211973ms iteration = 20 status = {}
29612024-11-08T01:33:12.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 28582aa5-2ab8-4547-b58c-49eaeff10e21 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29622024-11-08T01:33:12.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 28582aa5-2ab8-4547-b58c-49eaeff10e21 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29632024-11-08T01:33:12.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 28582aa5-2ab8-4547-b58c-49eaeff10e21 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29642024-11-08T01:33:12.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ab2797-93f2-4074-a25c-911ef8324002 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29652024-11-08T01:33:12.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ab2797-93f2-4074-a25c-911ef8324002 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29662024-11-08T01:33:12.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4ab2797-93f2-4074-a25c-911ef8324002 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29672024-11-08T01:33:13.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8239af2f-0fd6-47bb-a181-59065ab01b95 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29682024-11-08T01:33:13.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8239af2f-0fd6-47bb-a181-59065ab01b95 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29692024-11-08T01:33:13.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8239af2f-0fd6-47bb-a181-59065ab01b95 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29702024-11-08T01:33:14.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c98d49ad-fcbf-49b2-9027-f1a4f3fa88e2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29712024-11-08T01:33:14.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c98d49ad-fcbf-49b2-9027-f1a4f3fa88e2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29722024-11-08T01:33:14.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c98d49ad-fcbf-49b2-9027-f1a4f3fa88e2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29732024-11-08T01:33:15.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = fd85efec-ea7d-48a2-9c0b-aa768cc6b1c9 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
29742024-11-08T01:33:15.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bdc47e8-0992-42a5-a486-ad5abc92b704 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29752024-11-08T01:33:15.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bdc47e8-0992-42a5-a486-ad5abc92b704 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29762024-11-08T01:33:15.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7bdc47e8-0992-42a5-a486-ad5abc92b704 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29772024-11-08T01:33:16.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 55d0fde2-6efa-4fd5-9807-2ae86b2c5cca roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29782024-11-08T01:33:16.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 55d0fde2-6efa-4fd5-9807-2ae86b2c5cca resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29792024-11-08T01:33:16.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 55d0fde2-6efa-4fd5-9807-2ae86b2c5cca response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29802024-11-08T01:33:17.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 945a05d4-69db-4a49-80f3-1d2cb5d86e18 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29812024-11-08T01:33:17.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 945a05d4-69db-4a49-80f3-1d2cb5d86e18 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29822024-11-08T01:33:17.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 945a05d4-69db-4a49-80f3-1d2cb5d86e18 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29832024-11-08T01:33:18.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf485098-42a7-4e43-86a4-4eafbde14a69 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29842024-11-08T01:33:18.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf485098-42a7-4e43-86a4-4eafbde14a69 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29852024-11-08T01:33:18.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf485098-42a7-4e43-86a4-4eafbde14a69 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29862024-11-08T01:33:19.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5399ebd2-fa9b-464e-9f6a-1b6a46811635 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29872024-11-08T01:33:19.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5399ebd2-fa9b-464e-9f6a-1b6a46811635 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29882024-11-08T01:33:19.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5399ebd2-fa9b-464e-9f6a-1b6a46811635 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29892024-11-08T01:33:20.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f0b0e306-8d26-4131-9660-c57ff8af24f6 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29902024-11-08T01:33:20.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f0b0e306-8d26-4131-9660-c57ff8af24f6 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29912024-11-08T01:33:20.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f0b0e306-8d26-4131-9660-c57ff8af24f6 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
29922024-11-08T01:33:21.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
29932024-11-08T01:33:21.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29942024-11-08T01:33:21.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
29952024-11-08T01:33:21.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29962024-11-08T01:33:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29972024-11-08T01:33:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-11-08T01:33:21.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29992024-11-08T01:33:21.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002024-11-08T01:33:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30012024-11-08T01:33:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.956903ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30022024-11-08T01:33:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30032024-11-08T01:33:21.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042024-11-08T01:33:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30052024-11-08T01:33:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30062024-11-08T01:33:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30072024-11-08T01:33:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082024-11-08T01:33:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
30092024-11-08T01:33:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30102024-11-08T01:33:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30112024-11-08T01:33:21.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
30122024-11-08T01:33:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.112317ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
30132024-11-08T01:33:21.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b5a60a07-a892-4d75-be41-bf3d052177f1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30142024-11-08T01:33:21.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b5a60a07-a892-4d75-be41-bf3d052177f1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30152024-11-08T01:33:21.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b5a60a07-a892-4d75-be41-bf3d052177f1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30162024-11-08T01:33:22.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b0581942-bea7-456d-bbbe-b24c3597dfc0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30172024-11-08T01:33:22.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b0581942-bea7-456d-bbbe-b24c3597dfc0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30182024-11-08T01:33:22.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b0581942-bea7-456d-bbbe-b24c3597dfc0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30192024-11-08T01:33:23.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af12ee63-e291-4694-94f4-70c7e3c17ac2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30202024-11-08T01:33:23.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af12ee63-e291-4694-94f4-70c7e3c17ac2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30212024-11-08T01:33:23.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af12ee63-e291-4694-94f4-70c7e3c17ac2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30222024-11-08T01:33:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ecb77fa-75dd-4ec7-b99b-186469f84b6c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30232024-11-08T01:33:24.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ecb77fa-75dd-4ec7-b99b-186469f84b6c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30242024-11-08T01:33:24.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ecb77fa-75dd-4ec7-b99b-186469f84b6c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30252024-11-08T01:33:25.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d9d84c7-3a8e-4314-b9cc-c935bca583a4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30262024-11-08T01:33:25.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d9d84c7-3a8e-4314-b9cc-c935bca583a4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30272024-11-08T01:33:25.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d9d84c7-3a8e-4314-b9cc-c935bca583a4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30282024-11-08T01:33:26.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 17cec49d-ed08-4a47-a81e-57dabbf545ef roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30292024-11-08T01:33:26.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 17cec49d-ed08-4a47-a81e-57dabbf545ef resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30302024-11-08T01:33:26.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 17cec49d-ed08-4a47-a81e-57dabbf545ef response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30312024-11-08T01:33:27.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 506f0a5a-91e1-4dd1-b5ad-db39a7e3d18d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30322024-11-08T01:33:27.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 506f0a5a-91e1-4dd1-b5ad-db39a7e3d18d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30332024-11-08T01:33:27.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 506f0a5a-91e1-4dd1-b5ad-db39a7e3d18d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30342024-11-08T01:33:28.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 18eeb643-151c-45ae-822b-d2363a52afce roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30352024-11-08T01:33:28.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 18eeb643-151c-45ae-822b-d2363a52afce resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30362024-11-08T01:33:28.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 18eeb643-151c-45ae-822b-d2363a52afce response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30372024-11-08T01:33:29.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d37c3e15-fa54-4772-9608-e81a824761b8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30382024-11-08T01:33:29.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d37c3e15-fa54-4772-9608-e81a824761b8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30392024-11-08T01:33:29.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d37c3e15-fa54-4772-9608-e81a824761b8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30402024-11-08T01:33:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1471 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 3d1f9bfb-ab3b-41a1-98ea-a0f6541e0b52 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
30412024-11-08T01:33:30.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8e3d4b5-c186-4f76-adf0-8658404cca2b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30422024-11-08T01:33:30.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8e3d4b5-c186-4f76-adf0-8658404cca2b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30432024-11-08T01:33:30.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8e3d4b5-c186-4f76-adf0-8658404cca2b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30442024-11-08T01:33:31.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
30452024-11-08T01:33:31.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
30462024-11-08T01:33:31.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472024-11-08T01:33:31.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30482024-11-08T01:33:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30492024-11-08T01:33:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30502024-11-08T01:33:31.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30512024-11-08T01:33:31.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30522024-11-08T01:33:31.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30532024-11-08T01:33:31.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.380379ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30542024-11-08T01:33:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30552024-11-08T01:33:31.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30562024-11-08T01:33:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30572024-11-08T01:33:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30582024-11-08T01:33:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30592024-11-08T01:33:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602024-11-08T01:33:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
30612024-11-08T01:33:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30622024-11-08T01:33:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30632024-11-08T01:33:31.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
30642024-11-08T01:33:31.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.072987ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
30652024-11-08T01:33:31.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 295be35f-8fcd-4acf-99e3-957a5ab521d4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30662024-11-08T01:33:31.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 295be35f-8fcd-4acf-99e3-957a5ab521d4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30672024-11-08T01:33:31.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 295be35f-8fcd-4acf-99e3-957a5ab521d4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30682024-11-08T01:33:32.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f59b6b2d-ec52-4c4f-9aa7-97cf50bf4a87 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30692024-11-08T01:33:32.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f59b6b2d-ec52-4c4f-9aa7-97cf50bf4a87 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30702024-11-08T01:33:32.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f59b6b2d-ec52-4c4f-9aa7-97cf50bf4a87 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30712024-11-08T01:33:33.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 744be096-8876-47b7-b165-25c504371c64 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30722024-11-08T01:33:33.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 744be096-8876-47b7-b165-25c504371c64 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30732024-11-08T01:33:33.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 744be096-8876-47b7-b165-25c504371c64 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30742024-11-08T01:33:34.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3adaf15a-9f8d-43b2-b7ad-2ba4c4c3d75b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30752024-11-08T01:33:34.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3adaf15a-9f8d-43b2-b7ad-2ba4c4c3d75b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30762024-11-08T01:33:34.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3adaf15a-9f8d-43b2-b7ad-2ba4c4c3d75b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30772024-11-08T01:33:35.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 71436dce-6231-4725-8481-5ee315b1254b roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
30782024-11-08T01:33:35.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 71436dce-6231-4725-8481-5ee315b1254b resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
30792024-11-08T01:33:35.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 71436dce-6231-4725-8481-5ee315b1254b response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
30802024-11-08T01:33:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 95b1fce7-ef02-49d8-b5a3-8504b94d8d02 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
30812024-11-08T01:33:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 95b1fce7-ef02-49d8-b5a3-8504b94d8d02 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
30822024-11-08T01:33:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 95b1fce7-ef02-49d8-b5a3-8504b94d8d02 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
30832024-11-08T01:33:35.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef10e93b-b743-43b6-ba6e-ec63584bb6d2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30842024-11-08T01:33:35.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef10e93b-b743-43b6-ba6e-ec63584bb6d2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30852024-11-08T01:33:35.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef10e93b-b743-43b6-ba6e-ec63584bb6d2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30862024-11-08T01:33:36.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0f227e8a-33f8-4d27-ad5f-93eaf76400d5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30872024-11-08T01:33:36.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0f227e8a-33f8-4d27-ad5f-93eaf76400d5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30882024-11-08T01:33:36.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0f227e8a-33f8-4d27-ad5f-93eaf76400d5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30892024-11-08T01:33:37.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d76a9a1e-a1b4-4c37-aa84-aa4897655261 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30902024-11-08T01:33:37.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d76a9a1e-a1b4-4c37-aa84-aa4897655261 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30912024-11-08T01:33:37.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d76a9a1e-a1b4-4c37-aa84-aa4897655261 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30922024-11-08T01:33:38.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de954c6e-2e8a-48b1-98c6-d115b6476fc6 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30932024-11-08T01:33:38.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de954c6e-2e8a-48b1-98c6-d115b6476fc6 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30942024-11-08T01:33:38.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = de954c6e-2e8a-48b1-98c6-d115b6476fc6 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30952024-11-08T01:33:39.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f5ae0d30-dbbb-4b84-85f9-fc9f6a7ba708 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30962024-11-08T01:33:39.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f5ae0d30-dbbb-4b84-85f9-fc9f6a7ba708 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30972024-11-08T01:33:39.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f5ae0d30-dbbb-4b84-85f9-fc9f6a7ba708 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30982024-11-08T01:33:40.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fabea4e0-0c11-44c1-924d-4cceb46602a5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
30992024-11-08T01:33:40.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fabea4e0-0c11-44c1-924d-4cceb46602a5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
31002024-11-08T01:33:40.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fabea4e0-0c11-44c1-924d-4cceb46602a5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
31012024-11-08T01:33:41.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
31022024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
31032024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31042024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
31052024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31062024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31072024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
31082024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31092024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
31102024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31112024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31122024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
31132024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
31142024-11-08T01:33:41.275ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
31152024-11-08T01:33:41.275ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
31162024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
31172024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
31182024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31192024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.71\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
31202024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
31212024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
31222024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
31232024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
31242024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.2\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31252024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
31262024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
31272024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31282024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
31292024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31302024-11-08T01:33:41.275ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31312024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
31322024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31332024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
31342024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31352024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31362024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
31372024-11-08T01:33:41.275ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
31382024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
31392024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.16\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
31402024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31412024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
31422024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
31432024-11-08T01:33:41.275ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31442024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31452024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
31462024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31472024-11-08T01:33:41.275ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
31482024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31492024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
31502024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
31512024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
31522024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.78\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
31532024-11-08T01:33:41.275ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:23:41.275313348 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31542024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
31552024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31562024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
31572024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.64\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31582024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31592024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
31602024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31612024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
31622024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31632024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31642024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
31652024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
31662024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31672024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
31682024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
31692024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31702024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31712024-11-08T01:33:41.275ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
31722024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31732024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31742024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31752024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31762024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31772024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31782024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
31792024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31802024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31812024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31822024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31832024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31842024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31852024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31862024-11-08T01:33:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 486167116 } })
31872024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31882024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31892024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31902024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31912024-11-08T01:33:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31922024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31932024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31942024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31952024-11-08T01:33:41.276ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 486315938 } })
31962024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
31972024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.241576ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
31982024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31992024-11-08T01:33:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.198596ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32002024-11-08T01:33:41.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32012024-11-08T01:33:41.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32022024-11-08T01:33:41.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32032024-11-08T01:33:41.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32042024-11-08T01:33:41.279ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.030495ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32052024-11-08T01:33:41.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32062024-11-08T01:33:41.280ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.396013ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
32072024-11-08T01:33:41.281ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-11-08T01:33:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32092024-11-08T01:33:41.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32102024-11-08T01:33:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32112024-11-08T01:33:41.283ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122024-11-08T01:33:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
32132024-11-08T01:33:41.283ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32142024-11-08T01:33:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32152024-11-08T01:33:41.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:23:41.275313348 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32162024-11-08T01:33:41.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.708797ms iteration = 11 status = {"expiration":"2024-11-08T01:23:41.275313348Z","pruned":[]}
32172024-11-08T01:33:41.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 495540652 } })
32182024-11-08T01:33:41.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192024-11-08T01:33:41.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
32202024-11-08T01:33:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32212024-11-08T01:33:41.285ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32222024-11-08T01:33:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32232024-11-08T01:33:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32242024-11-08T01:33:41.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32252024-11-08T01:33:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32262024-11-08T01:33:41.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32272024-11-08T01:33:41.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32282024-11-08T01:33:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32292024-11-08T01:33:41.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32302024-11-08T01:33:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32312024-11-08T01:33:41.289ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32322024-11-08T01:33:41.289ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32332024-11-08T01:33:41.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32342024-11-08T01:33:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32352024-11-08T01:33:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32362024-11-08T01:33:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32372024-11-08T01:33:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32382024-11-08T01:33:41.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392024-11-08T01:33:41.292ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 502944552 } })
32402024-11-08T01:33:41.292ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
32412024-11-08T01:33:41.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32422024-11-08T01:33:41.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-11-08T01:33:41.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32442024-11-08T01:33:41.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.962858ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32452024-11-08T01:33:41.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32462024-11-08T01:33:41.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32472024-11-08T01:33:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32482024-11-08T01:33:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32492024-11-08T01:33:41.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32502024-11-08T01:33:41.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32512024-11-08T01:33:41.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32522024-11-08T01:33:41.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32532024-11-08T01:33:41.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32542024-11-08T01:33:41.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32552024-11-08T01:33:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32562024-11-08T01:33:41.298ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32572024-11-08T01:33:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32582024-11-08T01:33:41.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592024-11-08T01:33:41.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32602024-11-08T01:33:41.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32612024-11-08T01:33:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32622024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32632024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32642024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32652024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32662024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32672024-11-08T01:33:41.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32682024-11-08T01:33:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32692024-11-08T01:33:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32702024-11-08T01:33:41.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32712024-11-08T01:33:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32722024-11-08T01:33:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732024-11-08T01:33:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 517658650 } })
32742024-11-08T01:33:41.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
32752024-11-08T01:33:41.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32762024-11-08T01:33:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32772024-11-08T01:33:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32782024-11-08T01:33:41.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32792024-11-08T01:33:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32802024-11-08T01:33:41.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32812024-11-08T01:33:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32822024-11-08T01:33:41.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32832024-11-08T01:33:41.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32842024-11-08T01:33:41.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32852024-11-08T01:33:41.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32862024-11-08T01:33:41.322ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
32872024-11-08T01:33:41.322ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 790b2422-7827-4c4d-8d0a-acb89d201aae
32882024-11-08T01:33:41.322ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 7e760bfb-939f-474b-9b41-fda11ba6d552
32892024-11-08T01:33:41.322ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 93a69a87-db1c-4a49-aa6e-26b95f67ad3e
32902024-11-08T01:33:41.322ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 790b2422-7827-4c4d-8d0a-acb89d201aae
32912024-11-08T01:33:41.322ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 7e760bfb-939f-474b-9b41-fda11ba6d552
32922024-11-08T01:33:41.322ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 93a69a87-db1c-4a49-aa6e-26b95f67ad3e
32932024-11-08T01:33:41.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32942024-11-08T01:33:41.323ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32952024-11-08T01:33:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32962024-11-08T01:33:41.323ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
32972024-11-08T01:33:41.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32982024-11-08T01:33:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32992024-11-08T01:33:41.324ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(8528e433-77ae-438c-8a6c-b09f7d130d84, 0), (0ada262e-f920-4a98-9d78-e49eb5a95ed6, 0), (b63986c1-222f-43c0-a086-129f9b07c6f7, 0)]
33002024-11-08T01:33:41.325ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 535399678 } })
33012024-11-08T01:33:41.325ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 50.409658ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
33022024-11-08T01:33:41.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33032024-11-08T01:33:41.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33042024-11-08T01:33:41.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.372977ms iteration = 24 status = {"physical_disks_added":0}
33052024-11-08T01:33:41.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33062024-11-08T01:33:41.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072024-11-08T01:33:41.332ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33082024-11-08T01:33:41.332ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33092024-11-08T01:33:41.332ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.30339ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33102024-11-08T01:33:41.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112024-11-08T01:33:41.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33122024-11-08T01:33:41.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33132024-11-08T01:33:41.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33142024-11-08T01:33:41.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33152024-11-08T01:33:41.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33162024-11-08T01:33:41.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33172024-11-08T01:33:41.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33182024-11-08T01:33:41.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33192024-11-08T01:33:41.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33202024-11-08T01:33:41.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33212024-11-08T01:33:41.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33222024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33232024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
33242024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33252024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
33262024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 64.790481ms iteration = 12 status = {"generation":2}
33272024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33282024-11-08T01:33:41.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292024-11-08T01:33:41.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33302024-11-08T01:33:41.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33312024-11-08T01:33:41.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33322024-11-08T01:33:41.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33332024-11-08T01:33:41.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33342024-11-08T01:33:41.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352024-11-08T01:33:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33362024-11-08T01:33:41.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33372024-11-08T01:33:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33382024-11-08T01:33:41.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33392024-11-08T01:33:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33402024-11-08T01:33:41.353ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33412024-11-08T01:33:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33422024-11-08T01:33:41.355ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33432024-11-08T01:33:41.355ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33442024-11-08T01:33:41.355ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.801662ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33452024-11-08T01:33:41.355ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33462024-11-08T01:33:41.355ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.62909ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33472024-11-08T01:33:41.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33482024-11-08T01:33:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
33492024-11-08T01:33:41.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33502024-11-08T01:33:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33512024-11-08T01:33:41.361ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33522024-11-08T01:33:41.361ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33532024-11-08T01:33:41.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33542024-11-08T01:33:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33552024-11-08T01:33:41.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33562024-11-08T01:33:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33572024-11-08T01:33:41.366ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33582024-11-08T01:33:41.367ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33592024-11-08T01:33:41.367ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33602024-11-08T01:33:41.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33612024-11-08T01:33:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33622024-11-08T01:33:41.374ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632024-11-08T01:33:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33642024-11-08T01:33:41.378ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33652024-11-08T01:33:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33662024-11-08T01:33:41.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33672024-11-08T01:33:41.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33682024-11-08T01:33:41.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.783507ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33692024-11-08T01:33:41.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33702024-11-08T01:33:41.540ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33712024-11-08T01:33:41.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33722024-11-08T01:33:41.540ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fa3718e-baf3-4816-a3b2-c71642cc795f", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33732024-11-08T01:33:41.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33742024-11-08T01:33:41.542ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33752024-11-08T01:33:41.567ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
33762024-11-08T01:33:41.567ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33772024-11-08T01:33:41.568ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0ec7847-c79b-42aa-b696-140a9d4752da", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33782024-11-08T01:33:41.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33792024-11-08T01:33:41.569ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
33802024-11-08T01:33:41.569ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
33812024-11-08T01:33:41.569ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
33822024-11-08T01:33:41.569ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "faa9296b-20da-4366-a325-f02ab95c2564", "content-length": "476", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33832024-11-08T01:33:41.569ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
33842024-11-08T01:33:41.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
33852024-11-08T01:33:41.570ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc2f3e8e-3e86-4cb8-8312-02c9f74cffc4", "content-length": "734", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33862024-11-08T01:33:41.570ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
33872024-11-08T01:33:41.570ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5dfd872-08b1-45d5-97dc-18ba4c6112f7", "content-length": "111", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33882024-11-08T01:33:41.570ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
33892024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a27d4c9e-66be-460a-90bc-be1f67e83ce4", "content-length": "111", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33902024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
33912024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7b1bb0-379a-4119-9f92-9625bf7d0aa4", "content-length": "167", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33922024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
33932024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2954e3-9b89-43fa-80ef-c60652a8137d", "content-length": "167", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33942024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
33952024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb867ce3-2842-4ec6-9da2-1da32032a3b3", "content-length": "175", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33962024-11-08T01:33:41.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
33972024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ff770e6-f18c-4312-b0de-56507d1d2b5b", "content-length": "175", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
33982024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
33992024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6b0020b-c598-40c3-b8e8-78bf7215f56b", "content-length": "702", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34002024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34012024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5d47541-2deb-4356-8f79-d673a184221e", "content-length": "727", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34022024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34032024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3b5b01b-e547-4f53-9f80-1355a751ac14", "content-length": "729", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34042024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
34052024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2fe48d1-b8f8-452a-814d-6da0ad3a2040", "content-length": "728", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34062024-11-08T01:33:41.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
34072024-11-08T01:33:41.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "538eb0e7-e8f4-4a7b-8d69-84dedcfe047e", "content-length": "722", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34082024-11-08T01:33:41.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
34092024-11-08T01:33:41.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8880be9f-044f-4e38-bb0b-6ac6864b2d19", "content-length": "109", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34102024-11-08T01:33:41.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
34112024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "22d9c6c5-c23f-495a-ae73-234747122e9b", "content-length": "109", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34122024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
34132024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "deab4461-c133-43d5-a7b0-849e5dcdf403", "content-length": "169", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34142024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
34152024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "40730721-2715-478e-93ff-ee9289a871fe", "content-length": "169", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34162024-11-08T01:33:41.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
34172024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c641e9fe-ecab-40ae-9c2b-720529984cd4", "content-length": "178", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34182024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
34192024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "80d9bebf-9068-4d5e-ba26-a3408746f4b0", "content-length": "178", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34202024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
34212024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f7f71a-aabf-47be-9bff-20a1caf3693e", "content-length": "702", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34222024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34232024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f0efd43-f326-4e02-a1ed-6c994160689d", "content-length": "727", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34242024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34252024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75ba9792-c9ec-4f89-adda-3fdc6fbaba40", "content-length": "729", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34262024-11-08T01:33:41.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
34272024-11-08T01:33:41.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50490477-3b20-4c76-a711-7b5c5ee48f94", "content-length": "728", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34282024-11-08T01:33:41.576ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34292024-11-08T01:33:41.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34302024-11-08T01:33:41.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34312024-11-08T01:33:41.627ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34322024-11-08T01:33:41.627ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34332024-11-08T01:33:41.627ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "23f5312b-5a34-46c7-b402-7cf66dd14df7", "content-length": "372", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34342024-11-08T01:33:41.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34352024-11-08T01:33:41.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34362024-11-08T01:33:41.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34372024-11-08T01:33:41.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34382024-11-08T01:33:41.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34392024-11-08T01:33:41.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34402024-11-08T01:33:41.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34412024-11-08T01:33:41.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34432024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34442024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34452024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34462024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34472024-11-08T01:33:41.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34482024-11-08T01:33:41.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492024-11-08T01:33:41.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34502024-11-08T01:33:41.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34512024-11-08T01:33:41.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-11-08T01:33:41.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
34532024-11-08T01:33:41.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 366.568818ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
34542024-11-08T01:33:41.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
34552024-11-08T01:33:41.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34562024-11-08T01:33:41.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34572024-11-08T01:33:41.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34582024-11-08T01:33:41.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34592024-11-08T01:33:41.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34602024-11-08T01:33:41.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34612024-11-08T01:33:41.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34622024-11-08T01:33:41.645ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 370.407319ms iteration = 21 status = 0
34632024-11-08T01:33:41.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34642024-11-08T01:33:41.646ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34652024-11-08T01:33:41.646ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e56ccc8-193d-458e-8f3c-5a4292bd2368", "content-length": "26", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34662024-11-08T01:33:41.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34672024-11-08T01:33:41.649ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34682024-11-08T01:33:41.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34692024-11-08T01:33:41.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34702024-11-08T01:33:41.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-11-08T01:33:41.680ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34722024-11-08T01:33:41.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34732024-11-08T01:33:41.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 405.134985ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34742024-11-08T01:33:41.681ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34752024-11-08T01:33:41.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34762024-11-08T01:33:41.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34772024-11-08T01:33:41.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34782024-11-08T01:33:41.682ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34792024-11-08T01:33:41.682ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34802024-11-08T01:33:41.682ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "59fe8937-e552-4094-9db9-d3db91d37f8d", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
34812024-11-08T01:33:41.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34822024-11-08T01:33:41.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34832024-11-08T01:33:41.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
34842024-11-08T01:33:41.683ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34852024-11-08T01:33:41.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34862024-11-08T01:33:41.686ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-11-08T01:33:41.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34882024-11-08T01:33:41.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34892024-11-08T01:33:41.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
34902024-11-08T01:33:41.689ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34912024-11-08T01:33:41.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34922024-11-08T01:33:41.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34932024-11-08T01:33:41.690ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34942024-11-08T01:33:41.690ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34952024-11-08T01:33:41.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34962024-11-08T01:33:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34972024-11-08T01:33:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34982024-11-08T01:33:41.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-11-08T01:33:41.693ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35002024-11-08T01:33:41.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35012024-11-08T01:33:41.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7eae97e0-7ecc-4738-9033-6309d889f1fc", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
35022024-11-08T01:33:41.694ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35032024-11-08T01:33:41.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35042024-11-08T01:33:41.695ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 420.474951ms iteration = 22 status = {}
35052024-11-08T01:33:41.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35062024-11-08T01:33:41.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35072024-11-08T01:33:41.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35082024-11-08T01:33:41.699ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35092024-11-08T01:33:41.699ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35102024-11-08T01:33:41.699ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
35112024-11-08T01:33:41.699ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 424.10111ms iteration = 12 status = {"generation":1}
35122024-11-08T01:33:41.706ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35132024-11-08T01:33:41.707ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "46b70896-8798-49c5-9029-a3cbbb590100", "content-length": "1", "date": "Fri, 08 Nov 2024 01:33:40 GMT"} })
35142024-11-08T01:33:41.709ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35152024-11-08T01:33:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35162024-11-08T01:33:41.711ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 436.207913ms iteration = 21 status = null
35172024-11-08T01:33:41.723ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) }
35182024-11-08T01:33:41.723ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 448.030912ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35192024-11-08T01:33:41.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35202024-11-08T01:33:41.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35212024-11-08T01:33:41.724ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35222024-11-08T01:33:41.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35232024-11-08T01:33:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35242024-11-08T01:33:41.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35252024-11-08T01:33:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35262024-11-08T01:33:41.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35272024-11-08T01:33:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35282024-11-08T01:33:41.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35292024-11-08T01:33:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35302024-11-08T01:33:41.761ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35312024-11-08T01:33:41.761ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 485.946531ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35322024-11-08T01:33:41.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35332024-11-08T01:33:41.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dd7bc6a5-baa0-4962-8c1b-48bf99fec088", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35342024-11-08T01:33:41.824ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35352024-11-08T01:33:41.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3b25db9f-2fca-4c9d-8f40-2de9ad93b4b5", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35362024-11-08T01:33:41.827ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35372024-11-08T01:33:41.829ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35382024-11-08T01:33:41.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 553.995136ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35392024-11-08T01:33:41.835ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 559.799904ms iteration = 21 status = {}
35402024-11-08T01:33:41.860ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35412024-11-08T01:33:41.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8d005d9f-8608-4758-b6c0-28d532d57eba", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35422024-11-08T01:33:41.861ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35432024-11-08T01:33:41.864ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b6d6f06e-b835-4885-bb70-6c605f421dff", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35442024-11-08T01:33:41.864ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35452024-11-08T01:33:41.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aa2b8f0-0018-4fb6-a98d-3451a4bec86d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
35462024-11-08T01:33:41.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aa2b8f0-0018-4fb6-a98d-3451a4bec86d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
35472024-11-08T01:33:41.867ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "de9e0cf7-20bf-4277-86e1-d9b120230588", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35482024-11-08T01:33:41.867ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35492024-11-08T01:33:41.869ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35502024-11-08T01:33:41.869ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 594.726384ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35512024-11-08T01:33:41.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35522024-11-08T01:33:41.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35532024-11-08T01:33:41.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35542024-11-08T01:33:41.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35552024-11-08T01:33:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35562024-11-08T01:33:41.975ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
35572024-11-08T01:33:41.975ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
35582024-11-08T01:33:41.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7aa2b8f0-0018-4fb6-a98d-3451a4bec86d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
35592024-11-08T01:33:41.978ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
35602024-11-08T01:33:41.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35612024-11-08T01:33:41.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35622024-11-08T01:33:41.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35632024-11-08T01:33:41.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35642024-11-08T01:33:41.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35652024-11-08T01:33:41.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35662024-11-08T01:33:41.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35672024-11-08T01:33:41.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35682024-11-08T01:33:41.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35692024-11-08T01:33:41.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35702024-11-08T01:33:41.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35712024-11-08T01:33:41.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35722024-11-08T01:33:41.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35732024-11-08T01:33:41.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "90a8324c-f0d2-4c0d-8599-eac5ae38d3fd", "content-length": "134", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
35742024-11-08T01:33:41.988ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35752024-11-08T01:33:41.988ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
35762024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35772024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35782024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35792024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35802024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35812024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35822024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35832024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35842024-11-08T01:33:41.989ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
35852024-11-08T01:33:41.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35862024-11-08T01:33:41.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35872024-11-08T01:33:41.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35882024-11-08T01:33:41.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35892024-11-08T01:33:41.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35902024-11-08T01:33:41.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3a727ae-cca1-4216-b568-d6371611dd85", "content-length": "2", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
35912024-11-08T01:33:41.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35922024-11-08T01:33:41.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35932024-11-08T01:33:41.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "644e23eb-a10a-4f64-95fc-306adb0a9e67", "content-length": "52", "date": "Fri, 08 Nov 2024 01:33:41 GMT"} })
35942024-11-08T01:33:41.991ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
35952024-11-08T01:33:41.991ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35962024-11-08T01:33:41.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35972024-11-08T01:33:41.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982024-11-08T01:33:41.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35992024-11-08T01:33:41.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36002024-11-08T01:33:41.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36012024-11-08T01:33:42.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36022024-11-08T01:33:42.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36032024-11-08T01:33:42.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36042024-11-08T01:33:42.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36052024-11-08T01:33:42.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36062024-11-08T01:33:42.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36072024-11-08T01:33:42.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36082024-11-08T01:33:42.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36092024-11-08T01:33:42.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36102024-11-08T01:33:42.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36112024-11-08T01:33:42.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36122024-11-08T01:33:42.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36132024-11-08T01:33:42.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36142024-11-08T01:33:42.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36152024-11-08T01:33:42.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36162024-11-08T01:33:42.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6a54b84-f31d-4292-b18a-c2396a6766c7", "content-length": "691", "date": "Fri, 08 Nov 2024 01:33:42 GMT"} })
36172024-11-08T01:33:42.018ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36182024-11-08T01:33:42.018ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36192024-11-08T01:33:42.018ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36202024-11-08T01:33:42.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36212024-11-08T01:33:42.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36222024-11-08T01:33:42.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36232024-11-08T01:33:42.019ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 744.71366ms iteration = 21 status = {}
36242024-11-08T01:33:42.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36252024-11-08T01:33:42.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36262024-11-08T01:33:42.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36272024-11-08T01:33:42.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36282024-11-08T01:33:42.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292024-11-08T01:33:42.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36302024-11-08T01:33:42.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36312024-11-08T01:33:42.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36322024-11-08T01:33:42.035ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 8ba7518d-773f-4dea-ac99-6e1ca4b62add, kind: Service { id: e8c61244-4bf0-4b3f-97eb-9be9f19cd488 }, name: Name("external-dns-e8c61244-4bf0-4b3f-97eb-9be9f19cd488"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef2d86b4-cd87-4a5b-84c4-23fc7b334050, kind: Service { id: ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5 }, name: Name("external-dns-ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 161])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 1e06cd17-9e9e-430b-b22e-11c67e901951, kind: Service { id: ce5ef33e-32cb-450e-98ce-948d2d64bf58 }, name: Name("nexus-ce5ef33e-32cb-450e-98ce-948d2d64bf58"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3676b4e5-8ece-4ab9-8fa5-17ff64f9aa31, kind: Service { id: b7fd42ed-cd22-4507-9555-47740e266236 }, name: Name("nexus-b7fd42ed-cd22-4507-9555-47740e266236"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc5e6ef6-2557-41c0-81cc-873c3bae44e0, kind: Service { id: 342fecfa-d739-42a3-a354-8b70b3c745ce }, name: Name("nexus-342fecfa-d739-42a3-a354-8b70b3c745ce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
36332024-11-08T01:33:42.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36342024-11-08T01:33:42.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36352024-11-08T01:33:42.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362024-11-08T01:33:42.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36372024-11-08T01:33:42.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36382024-11-08T01:33:42.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36392024-11-08T01:33:42.040ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36402024-11-08T01:33:42.040ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8ba7518d-773f-4dea-ac99-6e1ca4b62add, kind: Service { id: e8c61244-4bf0-4b3f-97eb-9be9f19cd488 }, name: Name("external-dns-e8c61244-4bf0-4b3f-97eb-9be9f19cd488"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef2d86b4-cd87-4a5b-84c4-23fc7b334050, kind: Service { id: ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5 }, name: Name("external-dns-ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 161])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1e06cd17-9e9e-430b-b22e-11c67e901951, kind: Service { id: ce5ef33e-32cb-450e-98ce-948d2d64bf58 }, name: Name("nexus-ce5ef33e-32cb-450e-98ce-948d2d64bf58"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3676b4e5-8ece-4ab9-8fa5-17ff64f9aa31, kind: Service { id: b7fd42ed-cd22-4507-9555-47740e266236 }, name: Name("nexus-b7fd42ed-cd22-4507-9555-47740e266236"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc5e6ef6-2557-41c0-81cc-873c3bae44e0, kind: Service { id: 342fecfa-d739-42a3-a354-8b70b3c745ce }, name: Name("nexus-342fecfa-d739-42a3-a354-8b70b3c745ce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36412024-11-08T01:33:42.040ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36422024-11-08T01:33:42.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 0aca3c7b-80b9-410b-afd0-c45379a6f1f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36432024-11-08T01:33:42.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 0aca3c7b-80b9-410b-afd0-c45379a6f1f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36442024-11-08T01:33:42.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 0aca3c7b-80b9-410b-afd0-c45379a6f1f5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36452024-11-08T01:33:42.167ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 979cd0c3-718d-49ed-b7c9-9ea81462754d, time_created: 2024-11-08T01:24:15.199827Z, time_modified: 2024-11-08T01:24:15.199827Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
36462024-11-08T01:33:42.167ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
36472024-11-08T01:33:42.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36482024-11-08T01:33:42.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36492024-11-08T01:33:42.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36502024-11-08T01:33:42.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36512024-11-08T01:33:42.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-11-08T01:33:42.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
36532024-11-08T01:33:42.211ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
36542024-11-08T01:33:42.212ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "aeb81a81-d139-4612-b1a2-2f983cb848cf", "date": "Fri, 08 Nov 2024 01:33:42 GMT"} })
36552024-11-08T01:33:42.214ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
36562024-11-08T01:33:42.214ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 938.925969ms
36572024-11-08T01:33:42.214ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 938.936479ms iteration = 3 status = {}
36582024-11-08T01:33:42.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "aa18705e-0225-458e-b27e-24dd1a653f3c", "date": "Fri, 08 Nov 2024 01:33:42 GMT"} })
36592024-11-08T01:33:42.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
36602024-11-08T01:33:42.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36612024-11-08T01:33:42.271ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ca1fa08-9974-4430-b91f-7d1a7f8be454", "content-length": "682", "date": "Fri, 08 Nov 2024 01:33:42 GMT"} })
36622024-11-08T01:33:42.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36632024-11-08T01:33:42.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36642024-11-08T01:33:42.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36652024-11-08T01:33:42.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36662024-11-08T01:33:42.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36672024-11-08T01:33:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36682024-11-08T01:33:42.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36692024-11-08T01:33:42.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36702024-11-08T01:33:42.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.013237417s iteration = 21 status = {}
36712024-11-08T01:33:42.516ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb14e987-b332-4db3-99ee-86a852ed7e3f", "content-length": "29193", "date": "Fri, 08 Nov 2024 01:33:42 GMT"} })
36722024-11-08T01:33:42.518ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36732024-11-08T01:33:42.518ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
36742024-11-08T01:33:42.518ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
36752024-11-08T01:33:42.520ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36762024-11-08T01:33:42.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36772024-11-08T01:33:42.521ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782024-11-08T01:33:42.523ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
36792024-11-08T01:33:42.523ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36802024-11-08T01:33:42.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36812024-11-08T01:33:42.686ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a12b34a7-3627-4cb0-977e-5fd4f7700394 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
36822024-11-08T01:33:42.686ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a12b34a7-3627-4cb0-977e-5fd4f7700394 time_started = 2024-11-08 01:33:41.569008 UTC
36832024-11-08T01:33:42.686ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.411224407s iteration = 4 status = {"collection_id":"a12b34a7-3627-4cb0-977e-5fd4f7700394","time_done":"2024-11-08 01:33:42.518413 UTC","time_started":"2024-11-08 01:33:41.569008 UTC"}
36842024-11-08T01:33:42.686ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
36852024-11-08T01:33:42.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36862024-11-08T01:33:42.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36872024-11-08T01:33:42.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882024-11-08T01:33:42.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36892024-11-08T01:33:42.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36902024-11-08T01:33:42.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36912024-11-08T01:33:42.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36922024-11-08T01:33:42.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36932024-11-08T01:33:42.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-11-08T01:33:42.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36952024-11-08T01:33:42.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36962024-11-08T01:33:42.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36972024-11-08T01:33:42.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.703184ms iteration = 25 status = {"physical_disks_added":0}
36982024-11-08T01:33:43.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93f8233b-8d02-49ac-9f2a-634db466fa8d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
36992024-11-08T01:33:43.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93f8233b-8d02-49ac-9f2a-634db466fa8d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37002024-11-08T01:33:43.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93f8233b-8d02-49ac-9f2a-634db466fa8d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37012024-11-08T01:33:44.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 09c53f67-8d2e-48c8-8660-a246c3c9b25c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37022024-11-08T01:33:44.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 09c53f67-8d2e-48c8-8660-a246c3c9b25c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37032024-11-08T01:33:44.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 09c53f67-8d2e-48c8-8660-a246c3c9b25c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37042024-11-08T01:33:45.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98313038-c261-4453-b4da-9c0a2e9eca34 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37052024-11-08T01:33:45.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98313038-c261-4453-b4da-9c0a2e9eca34 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37062024-11-08T01:33:45.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 98313038-c261-4453-b4da-9c0a2e9eca34 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37072024-11-08T01:33:45.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1433 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 2fd408c2-da6c-4596-9641-7f75a6d269f6 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
37082024-11-08T01:33:46.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2c77061c-7061-4cef-adef-555d1224876e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37092024-11-08T01:33:46.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2c77061c-7061-4cef-adef-555d1224876e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37102024-11-08T01:33:46.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2c77061c-7061-4cef-adef-555d1224876e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37112024-11-08T01:33:47.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b54ad9c0-84a8-41f6-8535-13fcb62194d8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37122024-11-08T01:33:47.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b54ad9c0-84a8-41f6-8535-13fcb62194d8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37132024-11-08T01:33:47.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b54ad9c0-84a8-41f6-8535-13fcb62194d8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37142024-11-08T01:33:48.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 627fb528-8d07-4e25-be9c-60d759a99ac8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37152024-11-08T01:33:48.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 627fb528-8d07-4e25-be9c-60d759a99ac8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37162024-11-08T01:33:48.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 627fb528-8d07-4e25-be9c-60d759a99ac8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37172024-11-08T01:33:49.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 81aa5b9c-8cee-4d78-b899-be7534bd057e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37182024-11-08T01:33:49.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 81aa5b9c-8cee-4d78-b899-be7534bd057e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37192024-11-08T01:33:49.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 81aa5b9c-8cee-4d78-b899-be7534bd057e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37202024-11-08T01:33:50.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a59c2a6b-a95b-4447-ba04-58c190c61c12 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37212024-11-08T01:33:50.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a59c2a6b-a95b-4447-ba04-58c190c61c12 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37222024-11-08T01:33:50.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a59c2a6b-a95b-4447-ba04-58c190c61c12 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37232024-11-08T01:33:51.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cd24d709-4164-463e-9a49-37d3df6b140d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37242024-11-08T01:33:51.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cd24d709-4164-463e-9a49-37d3df6b140d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37252024-11-08T01:33:51.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cd24d709-4164-463e-9a49-37d3df6b140d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37262024-11-08T01:33:51.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
37272024-11-08T01:33:51.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
37282024-11-08T01:33:51.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37292024-11-08T01:33:51.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37302024-11-08T01:33:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37312024-11-08T01:33:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37322024-11-08T01:33:51.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37332024-11-08T01:33:51.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37342024-11-08T01:33:51.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37352024-11-08T01:33:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37362024-11-08T01:33:51.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37372024-11-08T01:33:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37382024-11-08T01:33:51.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37392024-11-08T01:33:51.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37402024-11-08T01:33:51.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37412024-11-08T01:33:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
37422024-11-08T01:33:51.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37432024-11-08T01:33:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37442024-11-08T01:33:51.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
37452024-11-08T01:33:51.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.955932ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
37462024-11-08T01:33:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.79026ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37472024-11-08T01:33:52.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 849fbd49-8c11-4231-8d21-39521ec55195 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37482024-11-08T01:33:52.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 849fbd49-8c11-4231-8d21-39521ec55195 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37492024-11-08T01:33:52.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 849fbd49-8c11-4231-8d21-39521ec55195 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37502024-11-08T01:33:53.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 62fa22bd-8bfb-4d54-afff-0d1b33fa3509 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37512024-11-08T01:33:53.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 62fa22bd-8bfb-4d54-afff-0d1b33fa3509 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37522024-11-08T01:33:53.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 62fa22bd-8bfb-4d54-afff-0d1b33fa3509 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37532024-11-08T01:33:54.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f75ab22f-3ac5-4069-9ed1-063625869929 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37542024-11-08T01:33:54.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f75ab22f-3ac5-4069-9ed1-063625869929 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37552024-11-08T01:33:54.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f75ab22f-3ac5-4069-9ed1-063625869929 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37562024-11-08T01:33:54.938ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51021
37572024-11-08T01:33:54.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51021 req_id = adf08914-31be-405c-8e88-17b741ab5501 roles = RoleSet { roles: {} } uri = /metrics/producers
37582024-11-08T01:33:54.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51021 req_id = adf08914-31be-405c-8e88-17b741ab5501 resource = Database result = Ok(()) uri = /metrics/producers
37592024-11-08T01:33:54.974ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 861af0e9-1a8a-48bd-a8ed-6c14b35576c5
37602024-11-08T01:33:54.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36068 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51021 req_id = adf08914-31be-405c-8e88-17b741ab5501 response_code = 201 uri = /metrics/producers
37612024-11-08T01:33:55.072ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64016
37622024-11-08T01:33:55.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64016 req_id = 04357067-a793-4e79-93e9-cd1374c5db6c roles = RoleSet { roles: {} } uri = /metrics/producers
37632024-11-08T01:33:55.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64016 req_id = 04357067-a793-4e79-93e9-cd1374c5db6c resource = Database result = Ok(()) uri = /metrics/producers
37642024-11-08T01:33:55.106ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = ca74b71f-49fb-469a-9605-bfd58f47f205
37652024-11-08T01:33:55.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33692 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64016 req_id = 04357067-a793-4e79-93e9-cd1374c5db6c response_code = 201 uri = /metrics/producers
37662024-11-08T01:33:55.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a240f4dd-e4cf-488f-b246-adb6d34647a0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37672024-11-08T01:33:55.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a240f4dd-e4cf-488f-b246-adb6d34647a0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37682024-11-08T01:33:55.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a240f4dd-e4cf-488f-b246-adb6d34647a0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37692024-11-08T01:33:56.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2105c523-6aec-4b2e-beda-adbce9a1d9cb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37702024-11-08T01:33:56.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2105c523-6aec-4b2e-beda-adbce9a1d9cb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37712024-11-08T01:33:56.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2105c523-6aec-4b2e-beda-adbce9a1d9cb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37722024-11-08T01:33:56.741ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48543
37732024-11-08T01:33:56.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48543 req_id = 14fb8773-531e-4004-b7cc-fd0f4413d873 roles = RoleSet { roles: {} } uri = /metrics/producers
37742024-11-08T01:33:56.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48543 req_id = 14fb8773-531e-4004-b7cc-fd0f4413d873 resource = Database result = Ok(()) uri = /metrics/producers
37752024-11-08T01:33:56.776ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d
37762024-11-08T01:33:56.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34480 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48543 req_id = 14fb8773-531e-4004-b7cc-fd0f4413d873 response_code = 201 uri = /metrics/producers
37772024-11-08T01:33:57.134ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58162
37782024-11-08T01:33:57.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = 1f2130e1-6daa-4709-980e-32e46926fcb2 roles = RoleSet { roles: {} } uri = /metrics/producers
37792024-11-08T01:33:57.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = 1f2130e1-6daa-4709-980e-32e46926fcb2 resource = Database result = Ok(()) uri = /metrics/producers
37802024-11-08T01:33:57.142ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = cb06a8fc-af98-4e26-90a6-5c333714c8a7
37812024-11-08T01:33:57.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8631 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58162 req_id = 1f2130e1-6daa-4709-980e-32e46926fcb2 response_code = 201 uri = /metrics/producers
37822024-11-08T01:33:57.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78572664-30c2-4d8e-b1e7-a4183409646b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37832024-11-08T01:33:57.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78572664-30c2-4d8e-b1e7-a4183409646b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37842024-11-08T01:33:57.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78572664-30c2-4d8e-b1e7-a4183409646b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37852024-11-08T01:33:58.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 140a711c-2fb1-48a9-b420-821e85e23f35 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37862024-11-08T01:33:58.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 140a711c-2fb1-48a9-b420-821e85e23f35 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37872024-11-08T01:33:58.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 140a711c-2fb1-48a9-b420-821e85e23f35 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37882024-11-08T01:33:59.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ac9fc56e-add8-434b-bdb2-f2122f0b6bae roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37892024-11-08T01:33:59.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ac9fc56e-add8-434b-bdb2-f2122f0b6bae resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37902024-11-08T01:33:59.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ac9fc56e-add8-434b-bdb2-f2122f0b6bae response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37912024-11-08T01:34:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = f75c13cb-bab3-4d94-b90f-64cbb2ca177a response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
37922024-11-08T01:34:00.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a9385118-0123-4d6f-9494-3f1ae5b4e9e7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37932024-11-08T01:34:00.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a9385118-0123-4d6f-9494-3f1ae5b4e9e7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37942024-11-08T01:34:00.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a9385118-0123-4d6f-9494-3f1ae5b4e9e7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
37952024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
37962024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
37972024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37982024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37992024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38002024-11-08T01:34:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38012024-11-08T01:34:01.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022024-11-08T01:34:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38032024-11-08T01:34:01.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-08T01:34:01.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-08T01:34:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38062024-11-08T01:34:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38072024-11-08T01:34:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38082024-11-08T01:34:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
38092024-11-08T01:34:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102024-11-08T01:34:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112024-11-08T01:34:01.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
38122024-11-08T01:34:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.433188ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
38132024-11-08T01:34:01.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38142024-11-08T01:34:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38152024-11-08T01:34:01.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.154695ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38162024-11-08T01:34:01.406ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:32845
38172024-11-08T01:34:01.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32845 req_id = 747d23fc-4ee6-43f9-88ad-65951e14f87d roles = RoleSet { roles: {} } uri = /metrics/producers
38182024-11-08T01:34:01.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32845 req_id = 747d23fc-4ee6-43f9-88ad-65951e14f87d resource = Database result = Ok(()) uri = /metrics/producers
38192024-11-08T01:34:01.412ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = f8b5c8d6-6ffd-4c5c-afa2-474a8cf9ea92
38202024-11-08T01:34:01.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6220 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32845 req_id = 747d23fc-4ee6-43f9-88ad-65951e14f87d response_code = 201 uri = /metrics/producers
38212024-11-08T01:34:01.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14b10b55-e5a4-4c22-b587-55abbb120151 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38222024-11-08T01:34:01.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14b10b55-e5a4-4c22-b587-55abbb120151 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38232024-11-08T01:34:01.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 14b10b55-e5a4-4c22-b587-55abbb120151 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38242024-11-08T01:34:02.296ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56758
38252024-11-08T01:34:02.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56758 req_id = a5854f1c-a03e-4458-a637-865da4d8b30f roles = RoleSet { roles: {} } uri = /metrics/producers
38262024-11-08T01:34:02.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56758 req_id = a5854f1c-a03e-4458-a637-865da4d8b30f resource = Database result = Ok(()) uri = /metrics/producers
38272024-11-08T01:34:02.331ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = d7ca6535-bec2-4045-807b-1d2c3d385a99
38282024-11-08T01:34:02.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35022 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56758 req_id = a5854f1c-a03e-4458-a637-865da4d8b30f response_code = 201 uri = /metrics/producers
38292024-11-08T01:34:02.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b50df7-4827-4cd3-a087-bfe8b0878a7d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38302024-11-08T01:34:02.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b50df7-4827-4cd3-a087-bfe8b0878a7d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38312024-11-08T01:34:02.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b50df7-4827-4cd3-a087-bfe8b0878a7d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38322024-11-08T01:34:03.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f9e9d71d-4f33-4119-85d9-aa51ee4ec85b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38332024-11-08T01:34:03.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f9e9d71d-4f33-4119-85d9-aa51ee4ec85b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38342024-11-08T01:34:03.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f9e9d71d-4f33-4119-85d9-aa51ee4ec85b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38352024-11-08T01:34:04.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb7ba85a-d779-4af3-b2ed-e5df21b3ee04 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38362024-11-08T01:34:04.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb7ba85a-d779-4af3-b2ed-e5df21b3ee04 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38372024-11-08T01:34:04.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = fb7ba85a-d779-4af3-b2ed-e5df21b3ee04 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38382024-11-08T01:34:05.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f6db2618-e37b-437f-96cd-f7c5ba6f6503 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38392024-11-08T01:34:05.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f6db2618-e37b-437f-96cd-f7c5ba6f6503 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38402024-11-08T01:34:05.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f6db2618-e37b-437f-96cd-f7c5ba6f6503 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38412024-11-08T01:34:06.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ebbff13f-0147-4f4a-900e-bb45379cf394 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38422024-11-08T01:34:06.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ebbff13f-0147-4f4a-900e-bb45379cf394 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38432024-11-08T01:34:06.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ebbff13f-0147-4f4a-900e-bb45379cf394 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38442024-11-08T01:34:07.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9ccd7c-d7c1-4d5c-98c2-88986aa0f40a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38452024-11-08T01:34:07.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9ccd7c-d7c1-4d5c-98c2-88986aa0f40a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38462024-11-08T01:34:07.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd9ccd7c-d7c1-4d5c-98c2-88986aa0f40a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38472024-11-08T01:34:08.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 49d45184-8280-4ac0-acbc-e5f011784cb7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38482024-11-08T01:34:08.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 49d45184-8280-4ac0-acbc-e5f011784cb7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38492024-11-08T01:34:08.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 49d45184-8280-4ac0-acbc-e5f011784cb7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38502024-11-08T01:34:09.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 72bb6ce2-8336-46bf-837f-736f8864daab roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38512024-11-08T01:34:09.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 72bb6ce2-8336-46bf-837f-736f8864daab resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38522024-11-08T01:34:09.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 72bb6ce2-8336-46bf-837f-736f8864daab response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38532024-11-08T01:34:10.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0cf450ff-5c2f-41d1-b026-3b880dfa158a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38542024-11-08T01:34:10.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0cf450ff-5c2f-41d1-b026-3b880dfa158a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38552024-11-08T01:34:10.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0cf450ff-5c2f-41d1-b026-3b880dfa158a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
38562024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
38572024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38582024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
38592024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
38602024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.98\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
38612024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
38622024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38632024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38642024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
38652024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
38662024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38672024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38682024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
38692024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.731\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38702024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
38712024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.45\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
38722024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
38732024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
38742024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.91\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38752024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
38762024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
38772024-11-08T01:34:11.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38782024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38792024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
38802024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38812024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38822024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
38832024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
38842024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38852024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38862024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
38872024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
38882024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38892024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38902024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38912024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38922024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38932024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38942024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38952024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38962024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38972024-11-08T01:34:11.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38982024-11-08T01:34:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38992024-11-08T01:34:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39002024-11-08T01:34:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39012024-11-08T01:34:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39022024-11-08T01:34:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39032024-11-08T01:34:11.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-11-08T01:34:11.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39052024-11-08T01:34:11.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39062024-11-08T01:34:11.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-11-08T01:34:11.278ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.052425ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39082024-11-08T01:34:11.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39092024-11-08T01:34:11.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102024-11-08T01:34:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-11-08T01:34:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39122024-11-08T01:34:11.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39132024-11-08T01:34:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39142024-11-08T01:34:11.281ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 491774662 } })
39152024-11-08T01:34:11.281ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
39162024-11-08T01:34:11.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 493586606 } })
39172024-11-08T01:34:11.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
39182024-11-08T01:34:11.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192024-11-08T01:34:11.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.857303ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39202024-11-08T01:34:11.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39212024-11-08T01:34:11.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39222024-11-08T01:34:11.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39232024-11-08T01:34:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39242024-11-08T01:34:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39252024-11-08T01:34:11.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262024-11-08T01:34:11.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-11-08T01:34:11.288ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 499103480 } })
39282024-11-08T01:34:11.290ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
39292024-11-08T01:34:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39302024-11-08T01:34:11.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39312024-11-08T01:34:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39322024-11-08T01:34:11.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39332024-11-08T01:34:11.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39342024-11-08T01:34:11.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39352024-11-08T01:34:11.297ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.888258ms iteration = 26 status = {"physical_disks_added":0}
39362024-11-08T01:34:11.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39372024-11-08T01:34:11.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-11-08T01:34:11.312ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39392024-11-08T01:34:11.312ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39402024-11-08T01:34:11.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39412024-11-08T01:34:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39422024-11-08T01:34:11.314ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39432024-11-08T01:34:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39442024-11-08T01:34:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39452024-11-08T01:34:11.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39462024-11-08T01:34:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39472024-11-08T01:34:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39482024-11-08T01:34:11.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39492024-11-08T01:34:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39502024-11-08T01:34:11.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39512024-11-08T01:34:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39522024-11-08T01:34:11.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39532024-11-08T01:34:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39542024-11-08T01:34:11.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39552024-11-08T01:34:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39562024-11-08T01:34:11.324ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39572024-11-08T01:34:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39582024-11-08T01:34:11.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39592024-11-08T01:34:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39602024-11-08T01:34:11.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39612024-11-08T01:34:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39622024-11-08T01:34:11.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39632024-11-08T01:34:11.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39642024-11-08T01:34:11.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.166664ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39652024-11-08T01:34:11.353ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39662024-11-08T01:34:11.353ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39672024-11-08T01:34:11.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39682024-11-08T01:34:11.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39692024-11-08T01:34:11.355ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39702024-11-08T01:34:11.356ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39712024-11-08T01:34:11.356ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.450925ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39722024-11-08T01:34:11.365ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39732024-11-08T01:34:11.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.253677ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39742024-11-08T01:34:11.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39752024-11-08T01:34:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
39762024-11-08T01:34:11.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39772024-11-08T01:34:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39782024-11-08T01:34:11.373ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39792024-11-08T01:34:11.373ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39802024-11-08T01:34:11.374ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf55bb39-9c7f-492a-841d-60fed025d967", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
39812024-11-08T01:34:11.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39822024-11-08T01:34:11.376ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39832024-11-08T01:34:11.384ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
39842024-11-08T01:34:11.384ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.820406ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
39852024-11-08T01:34:11.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-08T01:34:11.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39872024-11-08T01:34:11.389ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39882024-11-08T01:34:11.389ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "193b1e2f-f73b-4713-9cc8-e8994905bfec", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
39892024-11-08T01:34:11.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39902024-11-08T01:34:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
39912024-11-08T01:34:11.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39922024-11-08T01:34:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-11-08T01:34:11.392ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39942024-11-08T01:34:11.393ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.705636ms iteration = 22 status = 0
39952024-11-08T01:34:11.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
39962024-11-08T01:34:11.398ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39972024-11-08T01:34:11.398ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "208ea207-b693-4155-81cf-11399a9715eb", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
39982024-11-08T01:34:11.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39992024-11-08T01:34:11.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
40002024-11-08T01:34:11.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40012024-11-08T01:34:11.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40022024-11-08T01:34:11.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40032024-11-08T01:34:11.461ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40042024-11-08T01:34:11.461ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40052024-11-08T01:34:11.462ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eebf870b-6bb1-4c86-9977-95c2301534cb", "content-length": "372", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40062024-11-08T01:34:11.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40072024-11-08T01:34:11.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40082024-11-08T01:34:11.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40092024-11-08T01:34:11.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40102024-11-08T01:34:11.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40112024-11-08T01:34:11.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122024-11-08T01:34:11.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40132024-11-08T01:34:11.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40142024-11-08T01:34:11.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40152024-11-08T01:34:11.474ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40162024-11-08T01:34:11.474ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "069220cd-73e3-4251-b76c-1cdd2154a343", "content-length": "1", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40172024-11-08T01:34:11.476ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40182024-11-08T01:34:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40192024-11-08T01:34:11.478ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.78477ms iteration = 22 status = null
40202024-11-08T01:34:11.488ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 213.710093ms iteration = 22 status = {}
40212024-11-08T01:34:11.509ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40222024-11-08T01:34:11.510ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40232024-11-08T01:34:11.510ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "279628dc-88b3-41aa-9f04-7a5a525f522b", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40242024-11-08T01:34:11.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40252024-11-08T01:34:11.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40262024-11-08T01:34:11.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40272024-11-08T01:34:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40282024-11-08T01:34:11.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40292024-11-08T01:34:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40302024-11-08T01:34:11.520ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40312024-11-08T01:34:11.520ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40322024-11-08T01:34:11.520ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8fd9a38a-1f34-4a97-ada7-8ba4dfe86903", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40332024-11-08T01:34:11.522ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.104385ms iteration = 23 status = {}
40342024-11-08T01:34:11.593ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40352024-11-08T01:34:11.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40362024-11-08T01:34:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40372024-11-08T01:34:11.605ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
40382024-11-08T01:34:11.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40392024-11-08T01:34:11.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40402024-11-08T01:34:11.615ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40412024-11-08T01:34:11.615ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9fd795f-ce6c-4846-8426-91f1d7c9957b", "content-length": "134", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40422024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40432024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
40442024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40452024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40462024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40472024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40482024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40492024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40502024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40512024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40522024-11-08T01:34:11.615ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
40532024-11-08T01:34:11.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40542024-11-08T01:34:11.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40552024-11-08T01:34:11.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40562024-11-08T01:34:11.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "024a12b6-a508-4b23-99a5-5699b0483f9a", "content-length": "2", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40572024-11-08T01:34:11.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40582024-11-08T01:34:11.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3bb6017-f7ca-424d-9e52-4e5da30582bf", "content-length": "52", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40592024-11-08T01:34:11.618ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
40602024-11-08T01:34:11.618ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40612024-11-08T01:34:11.653ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "230397b5-5629-46d5-a762-b33c9a21f71d", "content-length": "691", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40622024-11-08T01:34:11.653ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40632024-11-08T01:34:11.653ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40642024-11-08T01:34:11.653ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40652024-11-08T01:34:11.655ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 380.844359ms iteration = 22 status = {}
40662024-11-08T01:34:11.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df13ca35-48d0-4c73-b784-91dab58f72e8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40672024-11-08T01:34:11.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df13ca35-48d0-4c73-b784-91dab58f72e8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40682024-11-08T01:34:11.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = df13ca35-48d0-4c73-b784-91dab58f72e8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40692024-11-08T01:34:11.752ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3299509d-7773-483d-a7b4-a296318c2e4f", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40702024-11-08T01:34:11.752ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
40712024-11-08T01:34:11.752ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40722024-11-08T01:34:11.752ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "18afc255-34bd-4750-8c11-7a5acd14774b", "content-length": "682", "date": "Fri, 08 Nov 2024 01:34:11 GMT"} })
40732024-11-08T01:34:11.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40742024-11-08T01:34:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40752024-11-08T01:34:11.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40762024-11-08T01:34:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40772024-11-08T01:34:11.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40782024-11-08T01:34:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40792024-11-08T01:34:11.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40802024-11-08T01:34:11.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40812024-11-08T01:34:11.767ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.421692ms iteration = 22 status = {}
40822024-11-08T01:34:12.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 1e794fe2-749a-44f0-bb14-49161b85715e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40832024-11-08T01:34:12.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 1e794fe2-749a-44f0-bb14-49161b85715e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40842024-11-08T01:34:12.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 1e794fe2-749a-44f0-bb14-49161b85715e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40852024-11-08T01:34:12.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8a312f0a-e533-4371-9357-b677c49ecd29 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40862024-11-08T01:34:12.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8a312f0a-e533-4371-9357-b677c49ecd29 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40872024-11-08T01:34:12.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8a312f0a-e533-4371-9357-b677c49ecd29 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40882024-11-08T01:34:13.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dcfd1361-1a8f-4fd1-b835-e458662568e7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40892024-11-08T01:34:13.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dcfd1361-1a8f-4fd1-b835-e458662568e7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40902024-11-08T01:34:13.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dcfd1361-1a8f-4fd1-b835-e458662568e7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40912024-11-08T01:34:14.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2cb0bfee-7a5e-4fd0-a136-fe7d674ae241 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40922024-11-08T01:34:14.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2cb0bfee-7a5e-4fd0-a136-fe7d674ae241 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40932024-11-08T01:34:14.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2cb0bfee-7a5e-4fd0-a136-fe7d674ae241 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40942024-11-08T01:34:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 49039242-73f5-4df2-9ee0-25eec4e5cf9d response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
40952024-11-08T01:34:15.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f47e03fc-245f-4cbc-a64f-806ba06bab70 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40962024-11-08T01:34:15.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f47e03fc-245f-4cbc-a64f-806ba06bab70 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40972024-11-08T01:34:15.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f47e03fc-245f-4cbc-a64f-806ba06bab70 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40982024-11-08T01:34:16.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9b4c18a3-b58c-49db-987a-f4ddda05b5c3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
40992024-11-08T01:34:16.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9b4c18a3-b58c-49db-987a-f4ddda05b5c3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41002024-11-08T01:34:16.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9b4c18a3-b58c-49db-987a-f4ddda05b5c3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41012024-11-08T01:34:17.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fd03982-994c-4dc6-8605-c6517813d27a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41022024-11-08T01:34:17.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fd03982-994c-4dc6-8605-c6517813d27a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41032024-11-08T01:34:17.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5fd03982-994c-4dc6-8605-c6517813d27a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41042024-11-08T01:34:18.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d557329-2fad-48d6-938d-ac78af8ebbc8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41052024-11-08T01:34:18.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d557329-2fad-48d6-938d-ac78af8ebbc8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41062024-11-08T01:34:18.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0d557329-2fad-48d6-938d-ac78af8ebbc8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41072024-11-08T01:34:19.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4a791fb4-e069-4f65-9e2f-a0f4f97bb747 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41082024-11-08T01:34:19.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4a791fb4-e069-4f65-9e2f-a0f4f97bb747 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41092024-11-08T01:34:19.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4a791fb4-e069-4f65-9e2f-a0f4f97bb747 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41102024-11-08T01:34:20.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 54bf1a69-f104-43d1-83c9-c941b736bb2c roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
41112024-11-08T01:34:20.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 54bf1a69-f104-43d1-83c9-c941b736bb2c resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
41122024-11-08T01:34:20.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 54bf1a69-f104-43d1-83c9-c941b736bb2c response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
41132024-11-08T01:34:20.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7e19efff-1586-48c5-8d2c-f237e4101828 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
41142024-11-08T01:34:20.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7e19efff-1586-48c5-8d2c-f237e4101828 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
41152024-11-08T01:34:20.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = 7e19efff-1586-48c5-8d2c-f237e4101828 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
41162024-11-08T01:34:20.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = da223564-8a47-4f1d-a873-b765caced36a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41172024-11-08T01:34:20.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = da223564-8a47-4f1d-a873-b765caced36a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41182024-11-08T01:34:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = da223564-8a47-4f1d-a873-b765caced36a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41192024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
41202024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
41212024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41222024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41232024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41242024-11-08T01:34:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41252024-11-08T01:34:21.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41262024-11-08T01:34:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41272024-11-08T01:34:21.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-11-08T01:34:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.261974ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41292024-11-08T01:34:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41302024-11-08T01:34:21.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41312024-11-08T01:34:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41322024-11-08T01:34:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41332024-11-08T01:34:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41342024-11-08T01:34:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352024-11-08T01:34:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
41362024-11-08T01:34:21.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41372024-11-08T01:34:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41382024-11-08T01:34:21.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
41392024-11-08T01:34:21.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.952085ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
41402024-11-08T01:34:21.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = efc47921-c55f-40f5-be3f-ae5eee743519 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41412024-11-08T01:34:21.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = efc47921-c55f-40f5-be3f-ae5eee743519 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41422024-11-08T01:34:21.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = efc47921-c55f-40f5-be3f-ae5eee743519 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41432024-11-08T01:34:22.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78b7b30c-4cb7-44f4-8451-0921e607ef03 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41442024-11-08T01:34:22.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78b7b30c-4cb7-44f4-8451-0921e607ef03 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41452024-11-08T01:34:22.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78b7b30c-4cb7-44f4-8451-0921e607ef03 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41462024-11-08T01:34:23.727ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
41472024-11-08T01:34:23.727ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
41482024-11-08T01:34:23.758ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
41492024-11-08T01:34:23.758ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:59166
41502024-11-08T01:34:23.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59166 req_id = 4ff1ba39-82f7-4d0e-a8a2-30906ecd7808 roles = RoleSet { roles: {} } uri = /metrics/producers
41512024-11-08T01:34:23.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59166 req_id = 4ff1ba39-82f7-4d0e-a8a2-30906ecd7808 resource = Database result = Ok(()) uri = /metrics/producers
41522024-11-08T01:34:23.772ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
41532024-11-08T01:34:23.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13793 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59166 req_id = 4ff1ba39-82f7-4d0e-a8a2-30906ecd7808 response_code = 201 uri = /metrics/producers
41542024-11-08T01:34:23.772ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4ff1ba39-82f7-4d0e-a8a2-30906ecd7808", "content-length": "41", "date": "Fri, 08 Nov 2024 01:34:23 GMT"} })
41552024-11-08T01:34:23.774ZDEBGnexus (producer-registration-task): registered with nexus successfully
41562024-11-08T01:34:23.774ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
41572024-11-08T01:34:23.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b0e34e-6913-4a74-ac92-bd079bbbe951 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41582024-11-08T01:34:23.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b0e34e-6913-4a74-ac92-bd079bbbe951 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41592024-11-08T01:34:23.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d9b0e34e-6913-4a74-ac92-bd079bbbe951 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41602024-11-08T01:34:24.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf94153d-e95a-45e2-b5c2-45e20faf7291 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41612024-11-08T01:34:24.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf94153d-e95a-45e2-b5c2-45e20faf7291 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41622024-11-08T01:34:24.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf94153d-e95a-45e2-b5c2-45e20faf7291 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41632024-11-08T01:34:26.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a3580d5-4e0b-465f-b0f3-180637362ab8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41642024-11-08T01:34:26.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a3580d5-4e0b-465f-b0f3-180637362ab8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41652024-11-08T01:34:26.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a3580d5-4e0b-465f-b0f3-180637362ab8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41662024-11-08T01:34:27.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef0ba9dc-b26e-4d6a-9eab-1a4aa347d89e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41672024-11-08T01:34:27.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef0ba9dc-b26e-4d6a-9eab-1a4aa347d89e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41682024-11-08T01:34:27.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef0ba9dc-b26e-4d6a-9eab-1a4aa347d89e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41692024-11-08T01:34:28.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c185ec8-5a94-43d0-90ee-af2b855eab5b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41702024-11-08T01:34:28.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c185ec8-5a94-43d0-90ee-af2b855eab5b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41712024-11-08T01:34:28.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7c185ec8-5a94-43d0-90ee-af2b855eab5b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41722024-11-08T01:34:29.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af3e99d4-566f-4ff4-9c49-dcdfdb0e3c90 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41732024-11-08T01:34:29.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af3e99d4-566f-4ff4-9c49-dcdfdb0e3c90 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41742024-11-08T01:34:29.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = af3e99d4-566f-4ff4-9c49-dcdfdb0e3c90 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41752024-11-08T01:34:30.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba925fe8-d9f1-4a2d-9ead-13d9f1018716 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41762024-11-08T01:34:30.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba925fe8-d9f1-4a2d-9ead-13d9f1018716 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41772024-11-08T01:34:30.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ba925fe8-d9f1-4a2d-9ead-13d9f1018716 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41782024-11-08T01:34:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1386 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 39ee6390-ef43-41f8-ac8e-8096128c2d83 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
41792024-11-08T01:34:31.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a86f219e-0667-4320-bb05-fd5f76debae8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41802024-11-08T01:34:31.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a86f219e-0667-4320-bb05-fd5f76debae8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41812024-11-08T01:34:31.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a86f219e-0667-4320-bb05-fd5f76debae8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
41822024-11-08T01:34:31.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
41832024-11-08T01:34:31.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
41842024-11-08T01:34:31.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41852024-11-08T01:34:31.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41862024-11-08T01:34:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41872024-11-08T01:34:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41882024-11-08T01:34:31.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41892024-11-08T01:34:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41902024-11-08T01:34:31.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912024-11-08T01:34:31.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.92538ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41922024-11-08T01:34:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41932024-11-08T01:34:31.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41942024-11-08T01:34:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41952024-11-08T01:34:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41962024-11-08T01:34:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41972024-11-08T01:34:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-11-08T01:34:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
41992024-11-08T01:34:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42002024-11-08T01:34:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42012024-11-08T01:34:31.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
42022024-11-08T01:34:31.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.643694ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
42032024-11-08T01:34:32.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 23aea322-8fc1-4af5-bbfb-3ee65a65d512 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42042024-11-08T01:34:32.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 23aea322-8fc1-4af5-bbfb-3ee65a65d512 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42052024-11-08T01:34:32.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 23aea322-8fc1-4af5-bbfb-3ee65a65d512 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42062024-11-08T01:34:33.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cea0b165-4c87-43a7-acdf-88bffd4b55b6 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42072024-11-08T01:34:33.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cea0b165-4c87-43a7-acdf-88bffd4b55b6 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42082024-11-08T01:34:33.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = cea0b165-4c87-43a7-acdf-88bffd4b55b6 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42092024-11-08T01:34:34.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74ed18a0-4e43-456f-8d42-aa17778ca5b1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42102024-11-08T01:34:34.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74ed18a0-4e43-456f-8d42-aa17778ca5b1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42112024-11-08T01:34:34.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 74ed18a0-4e43-456f-8d42-aa17778ca5b1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42122024-11-08T01:34:35.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d315a19b-77c7-4409-848b-1d4ff9c78c22 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42132024-11-08T01:34:35.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d315a19b-77c7-4409-848b-1d4ff9c78c22 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42142024-11-08T01:34:35.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d315a19b-77c7-4409-848b-1d4ff9c78c22 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42152024-11-08T01:34:36.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 50f22bf8-9c8b-4eff-b4f8-a55011c5a47e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42162024-11-08T01:34:36.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 50f22bf8-9c8b-4eff-b4f8-a55011c5a47e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42172024-11-08T01:34:36.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 50f22bf8-9c8b-4eff-b4f8-a55011c5a47e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42182024-11-08T01:34:37.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15aff4b4-868b-4f8a-9b48-3d2b415ed893 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42192024-11-08T01:34:37.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15aff4b4-868b-4f8a-9b48-3d2b415ed893 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42202024-11-08T01:34:37.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 15aff4b4-868b-4f8a-9b48-3d2b415ed893 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42212024-11-08T01:34:38.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 671f14e3-3aa5-408d-8358-a9e72a63f4de roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42222024-11-08T01:34:38.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 671f14e3-3aa5-408d-8358-a9e72a63f4de resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42232024-11-08T01:34:38.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 671f14e3-3aa5-408d-8358-a9e72a63f4de response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42242024-11-08T01:34:39.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a4c4e515-d69e-48e0-a8d7-19f39de23d70 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42252024-11-08T01:34:39.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a4c4e515-d69e-48e0-a8d7-19f39de23d70 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42262024-11-08T01:34:39.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a4c4e515-d69e-48e0-a8d7-19f39de23d70 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42272024-11-08T01:34:40.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d8d7b0d-2582-4672-9b38-2e6daad2c3be roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42282024-11-08T01:34:40.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d8d7b0d-2582-4672-9b38-2e6daad2c3be resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42292024-11-08T01:34:40.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2d8d7b0d-2582-4672-9b38-2e6daad2c3be response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
42302024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
42312024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
42322024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42332024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
42342024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42352024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42362024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42372024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
42382024-11-08T01:34:41.275ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
42392024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
42402024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.05\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
42412024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
42422024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42432024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42442024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
42452024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
42462024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42472024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42482024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
42492024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
42502024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42512024-11-08T01:34:41.275ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:24:41.275289814 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42522024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42532024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
42542024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
42552024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.32\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
42562024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
42572024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42582024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
42592024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42602024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
42612024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.52\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
42622024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
42632024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
42642024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42652024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.23\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42662024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
42672024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
42682024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
42692024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.55\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42702024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42712024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
42722024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42732024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
42742024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
42752024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42762024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
42772024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42782024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
42792024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42802024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
42812024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42822024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42832024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
42842024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
42852024-11-08T01:34:41.275ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42862024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42872024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
42882024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
42902024-11-08T01:34:41.275ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42912024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42922024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42932024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42942024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42952024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42962024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42972024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42982024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42992024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43002024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43012024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43022024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43032024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43042024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43052024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43062024-11-08T01:34:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43072024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43082024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43092024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43102024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43112024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43122024-11-08T01:34:41.276ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 486100765 } })
43132024-11-08T01:34:41.276ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 486100736 } })
43142024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43152024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.313217ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43162024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
43172024-11-08T01:34:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.341718ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
43182024-11-08T01:34:41.278ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.096932ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43192024-11-08T01:34:41.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202024-11-08T01:34:41.280ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:24:41.275289814 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43212024-11-08T01:34:41.280ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.431273ms iteration = 12 status = {"expiration":"2024-11-08T01:24:41.275289814Z","pruned":[]}
43222024-11-08T01:34:41.281ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 491224934 } })
43232024-11-08T01:34:41.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242024-11-08T01:34:41.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43252024-11-08T01:34:41.281ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
43262024-11-08T01:34:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43272024-11-08T01:34:41.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43282024-11-08T01:34:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43292024-11-08T01:34:41.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43302024-11-08T01:34:41.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43312024-11-08T01:34:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43322024-11-08T01:34:41.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43332024-11-08T01:34:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43342024-11-08T01:34:41.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43352024-11-08T01:34:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43362024-11-08T01:34:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43372024-11-08T01:34:41.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 497159494 } })
43382024-11-08T01:34:41.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43392024-11-08T01:34:41.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
43402024-11-08T01:34:41.287ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-11-08T01:34:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43422024-11-08T01:34:41.288ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.036875ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
43432024-11-08T01:34:41.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-11-08T01:34:41.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452024-11-08T01:34:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43462024-11-08T01:34:41.291ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43472024-11-08T01:34:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43482024-11-08T01:34:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43492024-11-08T01:34:41.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43502024-11-08T01:34:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43512024-11-08T01:34:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43522024-11-08T01:34:41.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43532024-11-08T01:34:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43542024-11-08T01:34:41.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43552024-11-08T01:34:41.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43562024-11-08T01:34:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43572024-11-08T01:34:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43582024-11-08T01:34:41.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43592024-11-08T01:34:41.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602024-11-08T01:34:41.296ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 506717473 } })
43612024-11-08T01:34:41.297ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
43622024-11-08T01:34:41.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43632024-11-08T01:34:41.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43642024-11-08T01:34:41.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43652024-11-08T01:34:41.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43662024-11-08T01:34:41.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-11-08T01:34:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43682024-11-08T01:34:41.306ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43692024-11-08T01:34:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43702024-11-08T01:34:41.326ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43712024-11-08T01:34:41.326ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43722024-11-08T01:34:41.326ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.073707ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43732024-11-08T01:34:41.329ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43742024-11-08T01:34:41.329ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43752024-11-08T01:34:41.329ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43762024-11-08T01:34:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43772024-11-08T01:34:41.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43782024-11-08T01:34:41.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43792024-11-08T01:34:41.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43802024-11-08T01:34:41.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43812024-11-08T01:34:41.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.826971ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43822024-11-08T01:34:41.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43832024-11-08T01:34:41.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43842024-11-08T01:34:41.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-11-08T01:34:41.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862024-11-08T01:34:41.339ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43872024-11-08T01:34:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43882024-11-08T01:34:41.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43892024-11-08T01:34:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43902024-11-08T01:34:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43912024-11-08T01:34:41.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43922024-11-08T01:34:41.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43932024-11-08T01:34:41.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43942024-11-08T01:34:41.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43952024-11-08T01:34:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43962024-11-08T01:34:41.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43972024-11-08T01:34:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43982024-11-08T01:34:41.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-11-08T01:34:41.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44002024-11-08T01:34:41.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012024-11-08T01:34:41.348ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44022024-11-08T01:34:41.348ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44032024-11-08T01:34:41.348ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44042024-11-08T01:34:41.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44052024-11-08T01:34:41.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44062024-11-08T01:34:41.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44072024-11-08T01:34:41.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44082024-11-08T01:34:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44092024-11-08T01:34:41.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102024-11-08T01:34:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
44112024-11-08T01:34:41.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44122024-11-08T01:34:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44132024-11-08T01:34:41.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
44142024-11-08T01:34:41.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44152024-11-08T01:34:41.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162024-11-08T01:34:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44172024-11-08T01:34:41.353ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44182024-11-08T01:34:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44192024-11-08T01:34:41.356ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.639523ms iteration = 23 status = 0
44202024-11-08T01:34:41.356ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44212024-11-08T01:34:41.356ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44222024-11-08T01:34:41.356ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44232024-11-08T01:34:41.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44242024-11-08T01:34:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44252024-11-08T01:34:41.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-11-08T01:34:41.360ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44272024-11-08T01:34:41.360ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44282024-11-08T01:34:41.360ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.097554ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44292024-11-08T01:34:41.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 97b29029-e1d3-4f3e-82c3-6fd19964afcd roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
44302024-11-08T01:34:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44312024-11-08T01:34:41.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44322024-11-08T01:34:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44332024-11-08T01:34:41.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 97b29029-e1d3-4f3e-82c3-6fd19964afcd resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
44342024-11-08T01:34:41.363ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44352024-11-08T01:34:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44362024-11-08T01:34:41.363ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44372024-11-08T01:34:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.55719ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44382024-11-08T01:34:41.365ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44392024-11-08T01:34:41.365ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
44402024-11-08T01:34:41.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44412024-11-08T01:34:41.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44422024-11-08T01:34:41.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
44432024-11-08T01:34:41.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.597195ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
44442024-11-08T01:34:41.370ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44452024-11-08T01:34:41.370ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44462024-11-08T01:34:41.370ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44472024-11-08T01:34:41.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44482024-11-08T01:34:41.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.9899ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44492024-11-08T01:34:41.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44502024-11-08T01:34:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44512024-11-08T01:34:41.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44522024-11-08T01:34:41.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-11-08T01:34:41.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44542024-11-08T01:34:41.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44552024-11-08T01:34:41.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44562024-11-08T01:34:41.428ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.459053ms iteration = 27 status = {"physical_disks_added":0}
44572024-11-08T01:34:41.442ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44582024-11-08T01:34:41.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44592024-11-08T01:34:41.463ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44602024-11-08T01:34:41.463ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe64c76e-e958-41ab-81df-8612d0781dec", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
44612024-11-08T01:34:41.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44622024-11-08T01:34:41.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44632024-11-08T01:34:41.495ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
44642024-11-08T01:34:41.495ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44652024-11-08T01:34:41.495ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d31685d-9244-4457-bd59-888ce19a232f", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
44662024-11-08T01:34:41.495ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44672024-11-08T01:34:41.497ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
44682024-11-08T01:34:41.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44692024-11-08T01:34:41.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44702024-11-08T01:34:41.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44712024-11-08T01:34:41.541ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44722024-11-08T01:34:41.542ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "879475e4-a33f-43ec-af28-15b727714a09", "content-length": "26", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
44732024-11-08T01:34:41.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44742024-11-08T01:34:41.544ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44752024-11-08T01:34:41.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44762024-11-08T01:34:41.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3a20ee2e-24d5-49b8-b34c-f8f6365b9a1c", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44772024-11-08T01:34:41.562ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44782024-11-08T01:34:41.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c89e1e62-8433-4506-93e0-f07bd442e4cc", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44792024-11-08T01:34:41.564ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44802024-11-08T01:34:41.566ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44812024-11-08T01:34:41.566ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.475548ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44822024-11-08T01:34:41.604ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44832024-11-08T01:34:41.630ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44842024-11-08T01:34:41.630ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ba6f1be-31fe-455c-98aa-86a58924e392", "content-length": "1", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
44852024-11-08T01:34:41.632ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44862024-11-08T01:34:41.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44872024-11-08T01:34:41.641ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44882024-11-08T01:34:41.641ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44892024-11-08T01:34:41.642ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dab3ad6-d1b4-4c30-979c-3e980e414ee3", "content-length": "372", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
44902024-11-08T01:34:41.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44912024-11-08T01:34:41.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44922024-11-08T01:34:41.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-08T01:34:41.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 281571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 97b29029-e1d3-4f3e-82c3-6fd19964afcd response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
44942024-11-08T01:34:41.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44952024-11-08T01:34:41.646ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44962024-11-08T01:34:41.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44972024-11-08T01:34:41.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982024-11-08T01:34:41.649ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.403712ms iteration = 23 status = null
44992024-11-08T01:34:41.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45002024-11-08T01:34:41.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45012024-11-08T01:34:41.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45022024-11-08T01:34:41.676ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45032024-11-08T01:34:41.676ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45042024-11-08T01:34:41.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 401.292644ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45052024-11-08T01:34:41.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-11-08T01:34:41.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-11-08T01:34:41.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45082024-11-08T01:34:41.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45092024-11-08T01:34:41.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45102024-11-08T01:34:41.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45112024-11-08T01:34:41.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45122024-11-08T01:34:41.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45132024-11-08T01:34:41.688ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
45142024-11-08T01:34:41.688ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45152024-11-08T01:34:41.688ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
45162024-11-08T01:34:41.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 413.446866ms iteration = 13 status = {"generation":2}
45172024-11-08T01:34:41.690ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45182024-11-08T01:34:41.690ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45192024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45202024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45212024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45222024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d4f1cc7d-8046-410f-a671-c7c0e15c012c", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45232024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45242024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45252024-11-08T01:34:41.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45262024-11-08T01:34:41.692ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) }
45272024-11-08T01:34:41.692ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 417.110057ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45282024-11-08T01:34:41.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292024-11-08T01:34:41.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45302024-11-08T01:34:41.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45312024-11-08T01:34:41.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45322024-11-08T01:34:41.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45332024-11-08T01:34:41.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45342024-11-08T01:34:41.698ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45352024-11-08T01:34:41.698ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45362024-11-08T01:34:41.698ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
45372024-11-08T01:34:41.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 423.621544ms iteration = 13 status = {"generation":1}
45382024-11-08T01:34:41.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45392024-11-08T01:34:41.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45402024-11-08T01:34:41.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45412024-11-08T01:34:41.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d47e884b-a3cd-4986-8317-0f99c57bdcc3", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45422024-11-08T01:34:41.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45432024-11-08T01:34:41.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "41867a15-1fdc-4286-8cc5-f8bd30fa84ee", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45442024-11-08T01:34:41.702ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45452024-11-08T01:34:41.702ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45462024-11-08T01:34:41.702ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45472024-11-08T01:34:41.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d1ee0820-8c7e-4a9e-8969-77c9cc6b8180", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45482024-11-08T01:34:41.703ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "50bdecdf-c10e-4aaa-bf22-59578e12a24b", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45492024-11-08T01:34:41.703ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45502024-11-08T01:34:41.706ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.168245ms iteration = 24 status = {}
45512024-11-08T01:34:41.706ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45522024-11-08T01:34:41.706ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 431.50163ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45532024-11-08T01:34:41.707ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 432.180079ms iteration = 23 status = {}
45542024-11-08T01:34:41.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45552024-11-08T01:34:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45562024-11-08T01:34:41.747ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
45572024-11-08T01:34:41.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45582024-11-08T01:34:41.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45592024-11-08T01:34:41.748ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45602024-11-08T01:34:41.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 472.937307ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45612024-11-08T01:34:41.757ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45622024-11-08T01:34:41.757ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bace55-a12d-4373-bd39-09eb05f8a861", "content-length": "134", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45632024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45642024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
45652024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45662024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45672024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45682024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45692024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45702024-11-08T01:34:41.757ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45712024-11-08T01:34:41.758ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45722024-11-08T01:34:41.758ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45732024-11-08T01:34:41.758ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
45742024-11-08T01:34:41.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45752024-11-08T01:34:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45762024-11-08T01:34:41.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45772024-11-08T01:34:41.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "81fee6c4-4f66-4269-8525-31465c4ed1a5", "content-length": "2", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45782024-11-08T01:34:41.760ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45792024-11-08T01:34:41.760ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae03656-85cd-4123-b37c-3c7c8c989169", "content-length": "52", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45802024-11-08T01:34:41.760ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
45812024-11-08T01:34:41.760ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45822024-11-08T01:34:41.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45832024-11-08T01:34:41.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c00ba5-54d9-4104-bf6f-c8f5a6a8c61c", "content-length": "691", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45842024-11-08T01:34:41.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45852024-11-08T01:34:41.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45862024-11-08T01:34:41.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45872024-11-08T01:34:41.861ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 585.859924ms iteration = 23 status = {}
45882024-11-08T01:34:41.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7e350f54-0360-4322-a225-75403bfa3504", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45892024-11-08T01:34:41.961ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
45902024-11-08T01:34:41.961ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45912024-11-08T01:34:41.965ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8583274-f7b4-46ec-ad17-f646dd3164e8", "content-length": "682", "date": "Fri, 08 Nov 2024 01:34:41 GMT"} })
45922024-11-08T01:34:41.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45932024-11-08T01:34:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45942024-11-08T01:34:41.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45952024-11-08T01:34:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45962024-11-08T01:34:41.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45972024-11-08T01:34:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45982024-11-08T01:34:41.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45992024-11-08T01:34:41.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46002024-11-08T01:34:41.983ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.200909ms iteration = 23 status = {}
46012024-11-08T01:34:42.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b6b74830-57e4-42da-b33a-3bc4002cac0d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46022024-11-08T01:34:42.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b6b74830-57e4-42da-b33a-3bc4002cac0d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46032024-11-08T01:34:42.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = b6b74830-57e4-42da-b33a-3bc4002cac0d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46042024-11-08T01:34:42.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a3d787c-4bb8-45e2-a1e2-689e60144438 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46052024-11-08T01:34:42.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a3d787c-4bb8-45e2-a1e2-689e60144438 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46062024-11-08T01:34:42.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a3d787c-4bb8-45e2-a1e2-689e60144438 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46072024-11-08T01:34:43.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 91b23fb2-b13b-40b8-a78d-b382b45a1c97 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46082024-11-08T01:34:43.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 91b23fb2-b13b-40b8-a78d-b382b45a1c97 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46092024-11-08T01:34:43.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 91b23fb2-b13b-40b8-a78d-b382b45a1c97 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46102024-11-08T01:34:44.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a901b9f6-b783-4657-8d0b-de4a249ef137 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46112024-11-08T01:34:44.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a901b9f6-b783-4657-8d0b-de4a249ef137 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46122024-11-08T01:34:44.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a901b9f6-b783-4657-8d0b-de4a249ef137 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46132024-11-08T01:34:45.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1268 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = a18b31ee-775d-4bc5-b3b2-e8f3233b8c09 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
46142024-11-08T01:34:45.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d023dbcb-e8eb-48c3-832a-556888fcfaa5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46152024-11-08T01:34:45.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d023dbcb-e8eb-48c3-832a-556888fcfaa5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46162024-11-08T01:34:45.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d023dbcb-e8eb-48c3-832a-556888fcfaa5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46172024-11-08T01:34:46.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c77af492-4a6e-4c96-9709-d6e558551927 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46182024-11-08T01:34:46.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c77af492-4a6e-4c96-9709-d6e558551927 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46192024-11-08T01:34:46.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c77af492-4a6e-4c96-9709-d6e558551927 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46202024-11-08T01:34:47.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42f46e84-1c15-407d-b880-daf34a25b9c7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46212024-11-08T01:34:47.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42f46e84-1c15-407d-b880-daf34a25b9c7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46222024-11-08T01:34:47.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 42f46e84-1c15-407d-b880-daf34a25b9c7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46232024-11-08T01:34:48.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4448ad8c-ca3e-4c67-8b5c-6aa652284650 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46242024-11-08T01:34:48.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4448ad8c-ca3e-4c67-8b5c-6aa652284650 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46252024-11-08T01:34:48.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4448ad8c-ca3e-4c67-8b5c-6aa652284650 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46262024-11-08T01:34:49.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f7a034c-b0c6-466c-b5b0-d64d2a6acab3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46272024-11-08T01:34:49.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f7a034c-b0c6-466c-b5b0-d64d2a6acab3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46282024-11-08T01:34:49.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7f7a034c-b0c6-466c-b5b0-d64d2a6acab3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46292024-11-08T01:34:50.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = efddd762-bb46-442f-9ed8-fc52d324c6d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
46302024-11-08T01:34:50.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = efddd762-bb46-442f-9ed8-fc52d324c6d2 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
46312024-11-08T01:34:50.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = efddd762-bb46-442f-9ed8-fc52d324c6d2 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?sort_by=id_ascending
46322024-11-08T01:34:50.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ecb701b8-2f61-48f8-ac98-c31baf8accc1 roles = RoleSet { roles: {} } uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
46332024-11-08T01:34:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ecb701b8-2f61-48f8-ac98-c31baf8accc1 resource = Database result = Ok(()) uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
46342024-11-08T01:34:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49958 req_id = ecb701b8-2f61-48f8-ac98-c31baf8accc1 response_code = 200 uri = /metrics/collectors/f8eb2395-07f4-4cb9-b50e-c37d78d1725d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOGI1YzhkNi02ZmZkLTRjNWMtYWZhMi00NzRhOGNmOWVhOTIifX0%3D
46352024-11-08T01:34:50.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aaf81fcf-2407-42d0-9378-8fc7e478c5ef roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46362024-11-08T01:34:50.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aaf81fcf-2407-42d0-9378-8fc7e478c5ef resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46372024-11-08T01:34:50.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aaf81fcf-2407-42d0-9378-8fc7e478c5ef response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46382024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
46392024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
46402024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46412024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46422024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46432024-11-08T01:34:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46442024-11-08T01:34:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452024-11-08T01:34:51.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46462024-11-08T01:34:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46472024-11-08T01:34:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46482024-11-08T01:34:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46492024-11-08T01:34:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46502024-11-08T01:34:51.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512024-11-08T01:34:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522024-11-08T01:34:51.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46532024-11-08T01:34:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
46542024-11-08T01:34:51.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46552024-11-08T01:34:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46562024-11-08T01:34:51.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
46572024-11-08T01:34:51.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.641888ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
46582024-11-08T01:34:51.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.794864ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46592024-11-08T01:34:51.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01dabc92-2cc5-4b03-a160-e17062bcb101 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46602024-11-08T01:34:51.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01dabc92-2cc5-4b03-a160-e17062bcb101 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46612024-11-08T01:34:51.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 01dabc92-2cc5-4b03-a160-e17062bcb101 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46622024-11-08T01:34:52.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f28cf356-5dc9-490d-8e92-147595dff108 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46632024-11-08T01:34:52.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f28cf356-5dc9-490d-8e92-147595dff108 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46642024-11-08T01:34:52.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f28cf356-5dc9-490d-8e92-147595dff108 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46652024-11-08T01:34:53.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ebd68e5-a7c7-46c8-a8fd-4c459ae17388 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46662024-11-08T01:34:53.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ebd68e5-a7c7-46c8-a8fd-4c459ae17388 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46672024-11-08T01:34:53.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6ebd68e5-a7c7-46c8-a8fd-4c459ae17388 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46682024-11-08T01:34:54.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eef4a6fe-f37f-42a8-a797-eb773b05672c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46692024-11-08T01:34:54.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eef4a6fe-f37f-42a8-a797-eb773b05672c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46702024-11-08T01:34:54.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eef4a6fe-f37f-42a8-a797-eb773b05672c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46712024-11-08T01:34:55.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d55bdd33-7360-44af-93e0-2130a93c9bbc roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46722024-11-08T01:34:55.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d55bdd33-7360-44af-93e0-2130a93c9bbc resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46732024-11-08T01:34:55.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d55bdd33-7360-44af-93e0-2130a93c9bbc response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46742024-11-08T01:34:56.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f2bf9eb1-9eab-4d28-a2f1-6239be18061c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46752024-11-08T01:34:56.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f2bf9eb1-9eab-4d28-a2f1-6239be18061c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46762024-11-08T01:34:56.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f2bf9eb1-9eab-4d28-a2f1-6239be18061c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46772024-11-08T01:34:58.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c86c92b5-3e79-4b1c-a549-42def89e49d0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46782024-11-08T01:34:58.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c86c92b5-3e79-4b1c-a549-42def89e49d0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46792024-11-08T01:34:58.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c86c92b5-3e79-4b1c-a549-42def89e49d0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46802024-11-08T01:34:59.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e7f5aae-4b22-404a-829e-da33908092ba roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46812024-11-08T01:34:59.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e7f5aae-4b22-404a-829e-da33908092ba resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46822024-11-08T01:34:59.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1e7f5aae-4b22-404a-829e-da33908092ba response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46832024-11-08T01:35:00.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f1fc55c9-8d7c-4aee-8f33-9fcc705c016a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46842024-11-08T01:35:00.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f1fc55c9-8d7c-4aee-8f33-9fcc705c016a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46852024-11-08T01:35:00.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f1fc55c9-8d7c-4aee-8f33-9fcc705c016a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46862024-11-08T01:35:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1368 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 04125bcc-d3cd-413f-836c-ec78c5c62c9a response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
46872024-11-08T01:35:01.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 787df0c8-97f3-40ab-bb6a-a513c35e869e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46882024-11-08T01:35:01.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 787df0c8-97f3-40ab-bb6a-a513c35e869e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46892024-11-08T01:35:01.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 787df0c8-97f3-40ab-bb6a-a513c35e869e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
46902024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
46912024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
46922024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46932024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46942024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46952024-11-08T01:35:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46962024-11-08T01:35:01.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46972024-11-08T01:35:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46982024-11-08T01:35:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46992024-11-08T01:35:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47002024-11-08T01:35:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47012024-11-08T01:35:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47022024-11-08T01:35:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47032024-11-08T01:35:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
47042024-11-08T01:35:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47052024-11-08T01:35:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47062024-11-08T01:35:01.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
47072024-11-08T01:35:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.175831ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
47082024-11-08T01:35:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47092024-11-08T01:35:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47102024-11-08T01:35:01.331ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.78837ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47112024-11-08T01:35:02.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 694b5dae-2e24-4e5d-8d4a-00da9808deb8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47122024-11-08T01:35:02.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 694b5dae-2e24-4e5d-8d4a-00da9808deb8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47132024-11-08T01:35:02.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 694b5dae-2e24-4e5d-8d4a-00da9808deb8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47142024-11-08T01:35:03.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b6adee4b-6577-493f-a7cb-0bc21291573c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47152024-11-08T01:35:03.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b6adee4b-6577-493f-a7cb-0bc21291573c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47162024-11-08T01:35:03.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b6adee4b-6577-493f-a7cb-0bc21291573c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47172024-11-08T01:35:04.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 29d59501-5728-4dd6-9468-92ad9ad4ee24 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47182024-11-08T01:35:04.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 29d59501-5728-4dd6-9468-92ad9ad4ee24 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47192024-11-08T01:35:04.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 29d59501-5728-4dd6-9468-92ad9ad4ee24 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47202024-11-08T01:35:05.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ba34097-6768-404b-81ca-5f47107e8cab roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47212024-11-08T01:35:05.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ba34097-6768-404b-81ca-5f47107e8cab resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47222024-11-08T01:35:05.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ba34097-6768-404b-81ca-5f47107e8cab response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47232024-11-08T01:35:06.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25b65a35-35a3-4b31-adf1-ffb0745d85ca roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47242024-11-08T01:35:06.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25b65a35-35a3-4b31-adf1-ffb0745d85ca resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47252024-11-08T01:35:06.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 25b65a35-35a3-4b31-adf1-ffb0745d85ca response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47262024-11-08T01:35:07.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93258f22-6ff5-406a-b3bf-dbf46b9adc21 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47272024-11-08T01:35:07.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93258f22-6ff5-406a-b3bf-dbf46b9adc21 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47282024-11-08T01:35:07.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 93258f22-6ff5-406a-b3bf-dbf46b9adc21 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47292024-11-08T01:35:08.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e82f158-e535-46fd-ad45-fd0a7d4b47e2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47302024-11-08T01:35:08.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e82f158-e535-46fd-ad45-fd0a7d4b47e2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47312024-11-08T01:35:08.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5e82f158-e535-46fd-ad45-fd0a7d4b47e2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47322024-11-08T01:35:09.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78072b8b-c586-4a23-8119-d8eaf6d3d95f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47332024-11-08T01:35:09.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78072b8b-c586-4a23-8119-d8eaf6d3d95f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47342024-11-08T01:35:09.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 78072b8b-c586-4a23-8119-d8eaf6d3d95f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47352024-11-08T01:35:10.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f338580-9b94-4931-befd-d1d51eea39fa roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47362024-11-08T01:35:10.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f338580-9b94-4931-befd-d1d51eea39fa resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47372024-11-08T01:35:10.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f338580-9b94-4931-befd-d1d51eea39fa response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
47382024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
47392024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
47402024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.34\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
47412024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
47422024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
47432024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47442024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.4\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
47452024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
47462024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.949\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47472024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.241\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47482024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
47492024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
47502024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47512024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
47522024-11-08T01:35:11.275ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47532024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
47542024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
47552024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47562024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47572024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
47582024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47592024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47602024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47612024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
47622024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
47632024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47642024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47652024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
47662024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47672024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
47682024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47692024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
47702024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
47722024-11-08T01:35:11.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47732024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47742024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47752024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47762024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47772024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47782024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47792024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47802024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47812024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47822024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47832024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47842024-11-08T01:35:11.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47852024-11-08T01:35:11.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47862024-11-08T01:35:11.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-11-08T01:35:11.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882024-11-08T01:35:11.279ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.546087ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47892024-11-08T01:35:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47902024-11-08T01:35:11.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47912024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47922024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47932024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47942024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47952024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47962024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47972024-11-08T01:35:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47982024-11-08T01:35:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992024-11-08T01:35:11.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 493729018 } })
48002024-11-08T01:35:11.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 493909601 } })
48012024-11-08T01:35:11.284ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
48022024-11-08T01:35:11.284ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
48032024-11-08T01:35:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48042024-11-08T01:35:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48052024-11-08T01:35:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48062024-11-08T01:35:11.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48072024-11-08T01:35:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48082024-11-08T01:35:11.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-11-08T01:35:11.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48102024-11-08T01:35:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48112024-11-08T01:35:11.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48122024-11-08T01:35:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48132024-11-08T01:35:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48142024-11-08T01:35:11.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48152024-11-08T01:35:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48162024-11-08T01:35:11.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48172024-11-08T01:35:11.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48182024-11-08T01:35:11.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48192024-11-08T01:35:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48202024-11-08T01:35:11.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48212024-11-08T01:35:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48222024-11-08T01:35:11.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48232024-11-08T01:35:11.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48242024-11-08T01:35:11.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48252024-11-08T01:35:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48262024-11-08T01:35:11.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48272024-11-08T01:35:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48282024-11-08T01:35:11.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48292024-11-08T01:35:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48302024-11-08T01:35:11.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.60711ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48312024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
48322024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48332024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48342024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48352024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48362024-11-08T01:35:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48372024-11-08T01:35:11.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.792533ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48382024-11-08T01:35:11.327ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48392024-11-08T01:35:11.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.29016ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48402024-11-08T01:35:11.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48412024-11-08T01:35:11.328ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 537881032 } })
48422024-11-08T01:35:11.328ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
48432024-11-08T01:35:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48442024-11-08T01:35:11.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48452024-11-08T01:35:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48462024-11-08T01:35:11.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48472024-11-08T01:35:11.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fb3fc57-efa9-4655-8038-0f4c7efdd717 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
48482024-11-08T01:35:11.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fb3fc57-efa9-4655-8038-0f4c7efdd717 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
48492024-11-08T01:35:11.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48502024-11-08T01:35:11.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48512024-11-08T01:35:11.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48522024-11-08T01:35:11.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7fb3fc57-efa9-4655-8038-0f4c7efdd717 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
48532024-11-08T01:35:11.339ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
48542024-11-08T01:35:11.339ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.741296ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
48552024-11-08T01:35:11.361ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48562024-11-08T01:35:11.361ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48572024-11-08T01:35:11.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48582024-11-08T01:35:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48592024-11-08T01:35:11.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-11-08T01:35:11.365ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48612024-11-08T01:35:11.365ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48622024-11-08T01:35:11.366ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8ca8ae4-c9eb-4081-9b6d-8ba5d8889e0c", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
48632024-11-08T01:35:11.366ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48642024-11-08T01:35:11.366ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48652024-11-08T01:35:11.366ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48662024-11-08T01:35:11.366ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33e8bfcd-2891-4e49-86c7-2cf4602ae037", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
48672024-11-08T01:35:11.366ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48682024-11-08T01:35:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
48692024-11-08T01:35:11.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48702024-11-08T01:35:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48712024-11-08T01:35:11.368ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48722024-11-08T01:35:11.369ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.535537ms iteration = 24 status = 0
48732024-11-08T01:35:11.369ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48742024-11-08T01:35:11.394ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.972879ms iteration = 28 status = {"physical_disks_added":0}
48752024-11-08T01:35:11.406ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48762024-11-08T01:35:11.406ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48772024-11-08T01:35:11.406ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.710507ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48782024-11-08T01:35:11.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48792024-11-08T01:35:11.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48802024-11-08T01:35:11.417ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
48812024-11-08T01:35:11.417ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48822024-11-08T01:35:11.417ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ab0e64-baae-4d84-a1f3-1844602697ce", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
48832024-11-08T01:35:11.417ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48842024-11-08T01:35:11.419ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
48852024-11-08T01:35:11.454ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.652091ms iteration = 24 status = {}
48862024-11-08T01:35:11.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48872024-11-08T01:35:11.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48882024-11-08T01:35:11.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892024-11-08T01:35:11.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48902024-11-08T01:35:11.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48912024-11-08T01:35:11.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48922024-11-08T01:35:11.474ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48932024-11-08T01:35:11.474ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b065ff1f-2940-4123-96a1-61ab7975d47e", "content-length": "1", "date": "Fri, 08 Nov 2024 01:35:10 GMT"} })
48942024-11-08T01:35:11.476ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48952024-11-08T01:35:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48962024-11-08T01:35:11.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48972024-11-08T01:35:11.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48982024-11-08T01:35:11.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48992024-11-08T01:35:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49002024-11-08T01:35:11.508ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49012024-11-08T01:35:11.508ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49022024-11-08T01:35:11.510ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.659514ms iteration = 24 status = null
49032024-11-08T01:35:11.570ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49042024-11-08T01:35:11.595ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb02f2f9-94a7-4637-bb81-360f3c6f749d", "content-length": "691", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49052024-11-08T01:35:11.595ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49062024-11-08T01:35:11.595ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49072024-11-08T01:35:11.595ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49082024-11-08T01:35:11.595ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee3558e3-d383-401f-9bcf-3663bcd28e73", "content-length": "372", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49092024-11-08T01:35:11.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49102024-11-08T01:35:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49112024-11-08T01:35:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.760874ms iteration = 24 status = {}
49122024-11-08T01:35:11.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49132024-11-08T01:35:11.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49142024-11-08T01:35:11.600ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
49152024-11-08T01:35:11.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49162024-11-08T01:35:11.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49172024-11-08T01:35:11.609ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49182024-11-08T01:35:11.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49192024-11-08T01:35:11.610ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "df523f7e-e51c-42ff-a5a1-0f724b5f5987", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49202024-11-08T01:35:11.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212024-11-08T01:35:11.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49222024-11-08T01:35:11.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49232024-11-08T01:35:11.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8920dce3-e96d-453a-ad2a-747534d9c4cf", "content-length": "134", "date": "Fri, 08 Nov 2024 01:35:10 GMT"} })
49242024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49252024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
49262024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49272024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49282024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49292024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49302024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49312024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49322024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49332024-11-08T01:35:11.611ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49342024-11-08T01:35:11.612ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
49352024-11-08T01:35:11.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49362024-11-08T01:35:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49372024-11-08T01:35:11.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49382024-11-08T01:35:11.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49392024-11-08T01:35:11.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49402024-11-08T01:35:11.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "714b1e05-fc43-4fa6-ae45-721fbdf6fe4e", "content-length": "2", "date": "Fri, 08 Nov 2024 01:35:10 GMT"} })
49412024-11-08T01:35:11.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49422024-11-08T01:35:11.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "de956781-5724-41e5-800f-346f0b48ae8a", "content-length": "52", "date": "Fri, 08 Nov 2024 01:35:10 GMT"} })
49432024-11-08T01:35:11.614ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
49442024-11-08T01:35:11.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49452024-11-08T01:35:11.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49462024-11-08T01:35:11.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49472024-11-08T01:35:11.618ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49482024-11-08T01:35:11.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49492024-11-08T01:35:11.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f21940d9-3ea9-43eb-8800-4dc87ab3cc80", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49502024-11-08T01:35:11.714ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
49512024-11-08T01:35:11.714ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49522024-11-08T01:35:11.715ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0b8617-862a-49d7-a5f1-3690b45ca3a0", "content-length": "682", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49532024-11-08T01:35:11.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49542024-11-08T01:35:11.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49552024-11-08T01:35:11.715ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ddba7665-e5a1-4f51-a1d7-64ebc4b8cfec", "date": "Fri, 08 Nov 2024 01:35:11 GMT"} })
49562024-11-08T01:35:11.717ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.715287ms iteration = 25 status = {}
49572024-11-08T01:35:11.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49582024-11-08T01:35:11.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49592024-11-08T01:35:11.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49602024-11-08T01:35:11.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49612024-11-08T01:35:11.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49622024-11-08T01:35:11.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49632024-11-08T01:35:11.731ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 455.799066ms iteration = 24 status = {}
49642024-11-08T01:35:12.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 221f70bb-9f7a-4815-b9bd-cdc1a40bb4f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
49652024-11-08T01:35:12.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 221f70bb-9f7a-4815-b9bd-cdc1a40bb4f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
49662024-11-08T01:35:12.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 221f70bb-9f7a-4815-b9bd-cdc1a40bb4f9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
49672024-11-08T01:35:12.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 21bc607d-e340-41b2-b5b0-2a01af3ca9d1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49682024-11-08T01:35:12.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 21bc607d-e340-41b2-b5b0-2a01af3ca9d1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49692024-11-08T01:35:12.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 21bc607d-e340-41b2-b5b0-2a01af3ca9d1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49702024-11-08T01:35:13.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 274cbdbc-0df4-415f-b7d6-3d0ee2467063 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49712024-11-08T01:35:13.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 274cbdbc-0df4-415f-b7d6-3d0ee2467063 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49722024-11-08T01:35:13.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 274cbdbc-0df4-415f-b7d6-3d0ee2467063 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49732024-11-08T01:35:14.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a8e00f-2482-4ad8-8ec4-00c010419041 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49742024-11-08T01:35:14.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a8e00f-2482-4ad8-8ec4-00c010419041 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49752024-11-08T01:35:14.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a8e00f-2482-4ad8-8ec4-00c010419041 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49762024-11-08T01:35:15.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1454 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 7ca3b50e-627d-48dc-afe6-d8de83a96011 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
49772024-11-08T01:35:15.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b84a9ac4-1ae4-4cda-87e1-a1852c6c04f3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49782024-11-08T01:35:15.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b84a9ac4-1ae4-4cda-87e1-a1852c6c04f3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49792024-11-08T01:35:15.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b84a9ac4-1ae4-4cda-87e1-a1852c6c04f3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49802024-11-08T01:35:16.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a02033be-edd6-4efe-a0d3-76966de808a0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49812024-11-08T01:35:16.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a02033be-edd6-4efe-a0d3-76966de808a0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49822024-11-08T01:35:16.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a02033be-edd6-4efe-a0d3-76966de808a0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49832024-11-08T01:35:17.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 115a9f39-fc7f-47a7-abcf-f9cb75762670 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49842024-11-08T01:35:17.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 115a9f39-fc7f-47a7-abcf-f9cb75762670 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49852024-11-08T01:35:17.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 115a9f39-fc7f-47a7-abcf-f9cb75762670 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49862024-11-08T01:35:18.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b042b410-04a0-4342-8e5d-00d0a1229965 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49872024-11-08T01:35:18.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b042b410-04a0-4342-8e5d-00d0a1229965 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49882024-11-08T01:35:18.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b042b410-04a0-4342-8e5d-00d0a1229965 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49892024-11-08T01:35:19.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 40bf3afd-a0cc-4b3c-bca9-8832c9e5ca7c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49902024-11-08T01:35:19.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 40bf3afd-a0cc-4b3c-bca9-8832c9e5ca7c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49912024-11-08T01:35:19.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 40bf3afd-a0cc-4b3c-bca9-8832c9e5ca7c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49922024-11-08T01:35:20.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b57435ab-0228-42a3-9915-c81b0cfd5f43 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49932024-11-08T01:35:20.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b57435ab-0228-42a3-9915-c81b0cfd5f43 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49942024-11-08T01:35:20.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b57435ab-0228-42a3-9915-c81b0cfd5f43 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
49952024-11-08T01:35:21.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
49962024-11-08T01:35:21.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
49972024-11-08T01:35:21.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49982024-11-08T01:35:21.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49992024-11-08T01:35:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50002024-11-08T01:35:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50012024-11-08T01:35:21.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022024-11-08T01:35:21.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50032024-11-08T01:35:21.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50042024-11-08T01:35:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50052024-11-08T01:35:21.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50062024-11-08T01:35:21.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.787645ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50072024-11-08T01:35:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082024-11-08T01:35:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50092024-11-08T01:35:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50102024-11-08T01:35:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-11-08T01:35:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
50122024-11-08T01:35:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50132024-11-08T01:35:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50142024-11-08T01:35:21.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
50152024-11-08T01:35:21.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.30404ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
50162024-11-08T01:35:21.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1adc3fcb-f257-4712-a090-4f7db7deef67 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50172024-11-08T01:35:21.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1adc3fcb-f257-4712-a090-4f7db7deef67 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50182024-11-08T01:35:21.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1adc3fcb-f257-4712-a090-4f7db7deef67 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50192024-11-08T01:35:22.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d1779db7-7c5d-488b-bc7f-8ab465066f92 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
50202024-11-08T01:35:22.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d1779db7-7c5d-488b-bc7f-8ab465066f92 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
50212024-11-08T01:35:22.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = d1779db7-7c5d-488b-bc7f-8ab465066f92 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
50222024-11-08T01:35:22.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 20c3d20a-3a8a-45b7-9bb0-b9581ed1b6dd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
50232024-11-08T01:35:22.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 20c3d20a-3a8a-45b7-9bb0-b9581ed1b6dd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
50242024-11-08T01:35:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 20c3d20a-3a8a-45b7-9bb0-b9581ed1b6dd response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
50252024-11-08T01:35:22.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f33249a-f66c-4307-b918-c479d7b71023 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50262024-11-08T01:35:22.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f33249a-f66c-4307-b918-c479d7b71023 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50272024-11-08T01:35:22.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1f33249a-f66c-4307-b918-c479d7b71023 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50282024-11-08T01:35:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8caa40b-5a9f-425f-b564-6c56cc1b473f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50292024-11-08T01:35:23.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8caa40b-5a9f-425f-b564-6c56cc1b473f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50302024-11-08T01:35:23.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b8caa40b-5a9f-425f-b564-6c56cc1b473f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50312024-11-08T01:35:24.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c40f7607-6b97-43fd-a7da-ed56c7b04c11 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50322024-11-08T01:35:24.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c40f7607-6b97-43fd-a7da-ed56c7b04c11 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50332024-11-08T01:35:24.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c40f7607-6b97-43fd-a7da-ed56c7b04c11 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50342024-11-08T01:35:25.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 56a34c63-847f-4a9e-9130-b0e2704b2c14 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50352024-11-08T01:35:25.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 56a34c63-847f-4a9e-9130-b0e2704b2c14 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50362024-11-08T01:35:25.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 56a34c63-847f-4a9e-9130-b0e2704b2c14 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50372024-11-08T01:35:26.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c84f4f26-77c1-4b0e-b3c9-e918a37c9043 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50382024-11-08T01:35:26.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c84f4f26-77c1-4b0e-b3c9-e918a37c9043 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50392024-11-08T01:35:26.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c84f4f26-77c1-4b0e-b3c9-e918a37c9043 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50402024-11-08T01:35:27.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6e3903da-1a7f-41d4-acd0-b1030253368d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50412024-11-08T01:35:27.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6e3903da-1a7f-41d4-acd0-b1030253368d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50422024-11-08T01:35:27.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6e3903da-1a7f-41d4-acd0-b1030253368d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50432024-11-08T01:35:28.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a2e6c598-f125-4bd2-a403-9c413011f2b7 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50442024-11-08T01:35:28.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a2e6c598-f125-4bd2-a403-9c413011f2b7 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50452024-11-08T01:35:28.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a2e6c598-f125-4bd2-a403-9c413011f2b7 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50462024-11-08T01:35:29.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99d6843-9580-4cff-9eb0-639a0c49b820 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50472024-11-08T01:35:29.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99d6843-9580-4cff-9eb0-639a0c49b820 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50482024-11-08T01:35:29.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e99d6843-9580-4cff-9eb0-639a0c49b820 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50492024-11-08T01:35:30.034ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b13453f-9872-401f-9d6d-01409efe69a2 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-08T01:35:30.028310711Z }
50502024-11-08T01:35:30.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b13453f-9872-401f-9d6d-01409efe69a2 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50512024-11-08T01:35:30.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b13453f-9872-401f-9d6d-01409efe69a2 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50522024-11-08T01:35:30.065ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:48861
50532024-11-08T01:35:30.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48861 req_id = f5a60298-ebab-40c4-acb3-76a1db9b40df roles = RoleSet { roles: {} } uri = /metrics/producers
50542024-11-08T01:35:30.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48861 req_id = f5a60298-ebab-40c4-acb3-76a1db9b40df resource = Database result = Ok(()) uri = /metrics/producers
50552024-11-08T01:35:30.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45022 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b13453f-9872-401f-9d6d-01409efe69a2 response_code = 204 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50562024-11-08T01:35:30.075ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a858100-cc01-40b2-8586-fe72e2ef08de uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-08T01:35:30.075764418Z }
50572024-11-08T01:35:30.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a858100-cc01-40b2-8586-fe72e2ef08de roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50582024-11-08T01:35:30.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a858100-cc01-40b2-8586-fe72e2ef08de resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50592024-11-08T01:35:30.101ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 6868d009-f608-4ad1-8284-b70dc5e246d3
50602024-11-08T01:35:30.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35197 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48861 req_id = f5a60298-ebab-40c4-acb3-76a1db9b40df response_code = 201 uri = /metrics/producers
50612024-11-08T01:35:30.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32365 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7a858100-cc01-40b2-8586-fe72e2ef08de response_code = 204 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
50622024-11-08T01:35:30.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1359 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = f59ec657-102d-4c34-b95f-bba180603819 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
50632024-11-08T01:35:30.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0012628c-1d87-4c83-a22b-51f591121c00 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50642024-11-08T01:35:30.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0012628c-1d87-4c83-a22b-51f591121c00 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50652024-11-08T01:35:30.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0012628c-1d87-4c83-a22b-51f591121c00 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50662024-11-08T01:35:31.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
50672024-11-08T01:35:31.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
50682024-11-08T01:35:31.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50692024-11-08T01:35:31.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50702024-11-08T01:35:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50712024-11-08T01:35:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50722024-11-08T01:35:31.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50732024-11-08T01:35:31.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50742024-11-08T01:35:31.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.923102ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50752024-11-08T01:35:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50762024-11-08T01:35:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50772024-11-08T01:35:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50782024-11-08T01:35:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50792024-11-08T01:35:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50802024-11-08T01:35:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50812024-11-08T01:35:31.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50822024-11-08T01:35:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
50832024-11-08T01:35:31.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50842024-11-08T01:35:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50852024-11-08T01:35:31.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
50862024-11-08T01:35:31.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.356303ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
50872024-11-08T01:35:31.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8c64bf79-c48f-4718-a92d-7c58723f2b08 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50882024-11-08T01:35:31.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8c64bf79-c48f-4718-a92d-7c58723f2b08 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50892024-11-08T01:35:31.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 8c64bf79-c48f-4718-a92d-7c58723f2b08 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50902024-11-08T01:35:32.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f8adf397-be9e-4a97-8c85-db1b69dd5736 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50912024-11-08T01:35:32.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f8adf397-be9e-4a97-8c85-db1b69dd5736 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50922024-11-08T01:35:32.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f8adf397-be9e-4a97-8c85-db1b69dd5736 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50932024-11-08T01:35:33.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64e98f3e-20a4-408c-9953-579da21b8478 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50942024-11-08T01:35:33.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64e98f3e-20a4-408c-9953-579da21b8478 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50952024-11-08T01:35:33.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 64e98f3e-20a4-408c-9953-579da21b8478 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50962024-11-08T01:35:34.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d569610b-705d-4329-88fc-f9343aa6c60d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50972024-11-08T01:35:34.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d569610b-705d-4329-88fc-f9343aa6c60d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50982024-11-08T01:35:34.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d569610b-705d-4329-88fc-f9343aa6c60d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
50992024-11-08T01:35:36.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a217f961-4a0c-48b8-bcbc-b9946f3a8f7a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51002024-11-08T01:35:36.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a217f961-4a0c-48b8-bcbc-b9946f3a8f7a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51012024-11-08T01:35:36.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a217f961-4a0c-48b8-bcbc-b9946f3a8f7a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51022024-11-08T01:35:37.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1fbb1cf7-858e-458f-b3f9-1061a4da6367 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51032024-11-08T01:35:37.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1fbb1cf7-858e-458f-b3f9-1061a4da6367 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51042024-11-08T01:35:37.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1fbb1cf7-858e-458f-b3f9-1061a4da6367 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51052024-11-08T01:35:38.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6094723b-b052-4222-8b7c-fe66e08c37c5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51062024-11-08T01:35:38.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6094723b-b052-4222-8b7c-fe66e08c37c5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51072024-11-08T01:35:38.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6094723b-b052-4222-8b7c-fe66e08c37c5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51082024-11-08T01:35:39.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 125dad23-3364-436b-a93c-cb01cba67b8d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51092024-11-08T01:35:39.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 125dad23-3364-436b-a93c-cb01cba67b8d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51102024-11-08T01:35:39.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 125dad23-3364-436b-a93c-cb01cba67b8d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51112024-11-08T01:35:39.624ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 20a16e55-e2bb-46da-8964-86e769161e2c uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-08T01:35:39.624211459Z }
51122024-11-08T01:35:39.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 20a16e55-e2bb-46da-8964-86e769161e2c roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
51132024-11-08T01:35:39.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 20a16e55-e2bb-46da-8964-86e769161e2c resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
51142024-11-08T01:35:39.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44693 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 20a16e55-e2bb-46da-8964-86e769161e2c response_code = 204 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
51152024-11-08T01:35:40.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ea8fa94-a917-4dd7-ab15-64f54fbfa3ff roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51162024-11-08T01:35:40.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ea8fa94-a917-4dd7-ab15-64f54fbfa3ff resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51172024-11-08T01:35:40.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9ea8fa94-a917-4dd7-ab15-64f54fbfa3ff response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51182024-11-08T01:35:40.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ec1a1329-d1ce-4153-85ff-d29bc0e3340b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
51192024-11-08T01:35:40.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ec1a1329-d1ce-4153-85ff-d29bc0e3340b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
51202024-11-08T01:35:40.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ec1a1329-d1ce-4153-85ff-d29bc0e3340b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
51212024-11-08T01:35:40.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = c05a3287-427b-4b00-96e5-f20a7f009cbf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51222024-11-08T01:35:40.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = c05a3287-427b-4b00-96e5-f20a7f009cbf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51232024-11-08T01:35:40.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = c05a3287-427b-4b00-96e5-f20a7f009cbf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51242024-11-08T01:35:41.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b14d3608-2e85-4326-80b6-c9413e22962f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51252024-11-08T01:35:41.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b14d3608-2e85-4326-80b6-c9413e22962f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51262024-11-08T01:35:41.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = b14d3608-2e85-4326-80b6-c9413e22962f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
51272024-11-08T01:35:41.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = af980967-55de-4b5d-b870-6678f04cbc34 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51282024-11-08T01:35:41.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = af980967-55de-4b5d-b870-6678f04cbc34 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51292024-11-08T01:35:41.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = af980967-55de-4b5d-b870-6678f04cbc34 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51302024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
51312024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
51322024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
51332024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51342024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51352024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51362024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51372024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
51382024-11-08T01:35:41.274ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 31c30021-27d0-4144-b370-020b716fe22c
51392024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.941\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"31c30021-27d0-4144-b370-020b716fe22c"}
51402024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
51412024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
51422024-11-08T01:35:41.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51432024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
51442024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51452024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51462024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51472024-11-08T01:35:41.274ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
51482024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
51492024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51502024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
51512024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.081\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51522024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
51532024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
51542024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51552024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51562024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51572024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
51582024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51592024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
51602024-11-08T01:35:41.275ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
51612024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51622024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
51632024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
51642024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51652024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
51662024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51672024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
51682024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.57\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
51692024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
51702024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
51712024-11-08T01:35:41.275ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-08 01:25:41.275078096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
51722024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
51732024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
51742024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51752024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51762024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51772024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
51782024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
51792024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51802024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51812024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
51822024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
51832024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.28\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51842024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
51852024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51862024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
51872024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
51882024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51892024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
51902024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
51912024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.51\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
51922024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
51932024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
51942024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51952024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51962024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51972024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51982024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51992024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52002024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52012024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52022024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52032024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52042024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52052024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52062024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52072024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52082024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52092024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52102024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52112024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52122024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52132024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52142024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52152024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52162024-11-08T01:35:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e8c61244-4bf0-4b3f-97eb-9be9f19cd488.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ef5130cd-7f2d-4f4c-b7ec-8dfd6a6f10e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2141, tv_nsec: 485450987 } })
52172024-11-08T01:35:41.275ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1d0f7a19-c5e9-4a4c-b57a-25adb46b102e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20753eb3-d1fb-4717-b209-2d5e3304298f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dbb6c142-90ea-4c4d-bada-c6eb92eacc59.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2141, tv_nsec: 485452177 } })
52182024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52192024-11-08T01:35:41.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52202024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52212024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52222024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
52232024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.289928ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
52242024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52252024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52262024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
52272024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.198605ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
52282024-11-08T01:35:41.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52292024-11-08T01:35:41.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52302024-11-08T01:35:41.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52312024-11-08T01:35:41.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322024-11-08T01:35:41.279ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.803521ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52332024-11-08T01:35:41.279ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52342024-11-08T01:35:41.279ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52352024-11-08T01:35:41.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52362024-11-08T01:35:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52372024-11-08T01:35:41.279ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52382024-11-08T01:35:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52392024-11-08T01:35:41.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52402024-11-08T01:35:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52412024-11-08T01:35:41.280ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2141, tv_nsec: 490189851 } })
52422024-11-08T01:35:41.280ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
52432024-11-08T01:35:41.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52442024-11-08T01:35:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
52452024-11-08T01:35:41.282ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52462024-11-08T01:35:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52472024-11-08T01:35:41.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2141, tv_nsec: 492764815 } })
52482024-11-08T01:35:41.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492024-11-08T01:35:41.283ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
52502024-11-08T01:35:41.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52512024-11-08T01:35:41.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52522024-11-08T01:35:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52532024-11-08T01:35:41.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52542024-11-08T01:35:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52552024-11-08T01:35:41.289ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52562024-11-08T01:35:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52572024-11-08T01:35:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52582024-11-08T01:35:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52592024-11-08T01:35:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52602024-11-08T01:35:41.292ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-08 01:25:41.275078096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52612024-11-08T01:35:41.292ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.653737ms iteration = 13 status = {"expiration":"2024-11-08T01:25:41.275078096Z","pruned":[]}
52622024-11-08T01:35:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.480798ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
52632024-11-08T01:35:41.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52642024-11-08T01:35:41.298ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52652024-11-08T01:35:41.298ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52662024-11-08T01:35:41.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52672024-11-08T01:35:41.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52682024-11-08T01:35:41.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52692024-11-08T01:35:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52702024-11-08T01:35:41.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52712024-11-08T01:35:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52722024-11-08T01:35:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
52732024-11-08T01:35:41.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52742024-11-08T01:35:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52752024-11-08T01:35:41.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-11-08T01:35:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
52772024-11-08T01:35:41.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52782024-11-08T01:35:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52792024-11-08T01:35:41.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802024-11-08T01:35:41.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52812024-11-08T01:35:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52822024-11-08T01:35:41.308ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52832024-11-08T01:35:41.308ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52842024-11-08T01:35:41.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52852024-11-08T01:35:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52862024-11-08T01:35:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
52872024-11-08T01:35:41.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52882024-11-08T01:35:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52892024-11-08T01:35:41.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52902024-11-08T01:35:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52912024-11-08T01:35:41.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52922024-11-08T01:35:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52932024-11-08T01:35:41.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52942024-11-08T01:35:41.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952024-11-08T01:35:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52962024-11-08T01:35:41.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52972024-11-08T01:35:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52982024-11-08T01:35:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
52992024-11-08T01:35:41.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53002024-11-08T01:35:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53012024-11-08T01:35:41.328ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53022024-11-08T01:35:41.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53032024-11-08T01:35:41.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53042024-11-08T01:35:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53052024-11-08T01:35:41.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53062024-11-08T01:35:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53072024-11-08T01:35:41.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-11-08T01:35:41.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53092024-11-08T01:35:41.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53102024-11-08T01:35:41.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53112024-11-08T01:35:41.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122024-11-08T01:35:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53132024-11-08T01:35:41.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53142024-11-08T01:35:41.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53152024-11-08T01:35:41.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53162024-11-08T01:35:41.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53172024-11-08T01:35:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53182024-11-08T01:35:41.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53192024-11-08T01:35:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53202024-11-08T01:35:41.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53212024-11-08T01:35:41.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53222024-11-08T01:35:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53232024-11-08T01:35:41.348ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53242024-11-08T01:35:41.349ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53252024-11-08T01:35:41.349ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.860813ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53262024-11-08T01:35:41.356ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
53272024-11-08T01:35:41.356ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
53282024-11-08T01:35:41.356ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.252302ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
53292024-11-08T01:35:41.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302024-11-08T01:35:41.357ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53312024-11-08T01:35:41.357ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53322024-11-08T01:35:41.357ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.788223ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53332024-11-08T01:35:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53342024-11-08T01:35:41.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53352024-11-08T01:35:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53362024-11-08T01:35:41.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53372024-11-08T01:35:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.150605ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53382024-11-08T01:35:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53392024-11-08T01:35:41.365ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53402024-11-08T01:35:41.365ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53412024-11-08T01:35:41.365ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53422024-11-08T01:35:41.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53432024-11-08T01:35:41.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53442024-11-08T01:35:41.386ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53452024-11-08T01:35:41.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53462024-11-08T01:35:41.402ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53472024-11-08T01:35:41.402ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53482024-11-08T01:35:41.402ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53492024-11-08T01:35:41.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53502024-11-08T01:35:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53512024-11-08T01:35:41.443ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53522024-11-08T01:35:41.443ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53532024-11-08T01:35:41.443ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f4a8e48-421c-48d4-8d2c-ecf8a5e6ef53", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
53542024-11-08T01:35:41.443ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53552024-11-08T01:35:41.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53562024-11-08T01:35:41.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53572024-11-08T01:35:41.463ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53582024-11-08T01:35:41.463ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1690654e-7ccc-4856-b501-179077bc9d4b", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
53592024-11-08T01:35:41.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53602024-11-08T01:35:41.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53612024-11-08T01:35:41.594ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53622024-11-08T01:35:41.608ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53632024-11-08T01:35:41.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "688faf55-ce34-4227-8559-ef32dbbe8472", "content-length": "2", "date": "Fri, 08 Nov 2024 01:35:40 GMT"} })
53642024-11-08T01:35:41.610ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53652024-11-08T01:35:41.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53662024-11-08T01:35:41.615ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.381255ms iteration = 25 status = {}
53672024-11-08T01:35:41.655ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53682024-11-08T01:35:41.726ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/7b6d8997-9b24-486b-b46a-9c6931d94664/state
53692024-11-08T01:35:41.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53702024-11-08T01:35:41.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 455.148707ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53712024-11-08T01:35:41.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2141, tv_nsec: 941384565 } })
53722024-11-08T01:35:41.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
53732024-11-08T01:35:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53742024-11-08T01:35:41.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53752024-11-08T01:35:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53762024-11-08T01:35:41.735ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 459.992803ms iteration = 6 status = {"nsuccess":5}
53772024-11-08T01:35:41.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53782024-11-08T01:35:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53792024-11-08T01:35:41.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53802024-11-08T01:35:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53812024-11-08T01:35:41.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
53822024-11-08T01:35:41.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 469.721833ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
53832024-11-08T01:35:41.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53842024-11-08T01:35:41.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53852024-11-08T01:35:41.746ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.566558ms iteration = 25 status = null
53862024-11-08T01:35:41.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53872024-11-08T01:35:41.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53882024-11-08T01:35:41.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53892024-11-08T01:35:41.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53902024-11-08T01:35:41.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53912024-11-08T01:35:41.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53922024-11-08T01:35:41.789ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53932024-11-08T01:35:41.789ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53942024-11-08T01:35:41.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53952024-11-08T01:35:41.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53962024-11-08T01:35:41.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53972024-11-08T01:35:41.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53982024-11-08T01:35:41.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53992024-11-08T01:35:41.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54002024-11-08T01:35:41.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54012024-11-08T01:35:41.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54022024-11-08T01:35:41.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
54032024-11-08T01:35:41.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54042024-11-08T01:35:41.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54052024-11-08T01:35:41.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54062024-11-08T01:35:41.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54072024-11-08T01:35:41.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54082024-11-08T01:35:41.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54092024-11-08T01:35:41.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54102024-11-08T01:35:41.799ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54112024-11-08T01:35:41.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54122024-11-08T01:35:41.806ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 531.2722ms iteration = 25 status = 0
54132024-11-08T01:35:41.807ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8d88f02a-e0f4-4293-a6d4-c598127ff875 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54142024-11-08T01:35:41.807ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54152024-11-08T01:35:41.807ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-08 01:24:21.472295 UTC dns_group = internal generation = 1
54162024-11-08T01:35:41.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 532.803391ms iteration = 14 status = {"generation":1}
54172024-11-08T01:35:41.824ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54182024-11-08T01:35:41.824ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 0 version = 2
54192024-11-08T01:35:41.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54202024-11-08T01:35:41.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54212024-11-08T01:35:41.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54222024-11-08T01:35:41.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ee23a26a-c6c3-4fb5-a2dd-e8a103ecfaaf", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54232024-11-08T01:35:41.831ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54242024-11-08T01:35:41.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "527db46b-502c-48ea-83a2-a491d1ffe6d0", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54252024-11-08T01:35:41.832ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54262024-11-08T01:35:41.834ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54272024-11-08T01:35:41.834ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 559.955206ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54282024-11-08T01:35:41.840ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54292024-11-08T01:35:41.840ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 565.259038ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54302024-11-08T01:35:41.850ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
54312024-11-08T01:35:41.850ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54322024-11-08T01:35:41.851ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-08T01:23:39.423410Z, time_modified: 2024-11-08T01:23:39.423410Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e8022873-0d52-4c5d-be7f-834a19a05c7d, db_silo: Silo { identity: SiloIdentity { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-08T01:24:22.189648Z, time_modified: 2024-11-08T01:24:22.189648Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
54332024-11-08T01:35:41.851ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 576.206154ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]}},"default_endpoint":{"silo_id":"e8022873-0d52-4c5d-be7f-834a19a05c7d","tls_certs":["b6e142a9441a302022a68227e93e863ee96d4918131ebdfc854be093d09bb595"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54342024-11-08T01:35:41.851ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa93bbe5-3fb1-4548-a63c-f5902c1514e2", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
54352024-11-08T01:35:41.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54362024-11-08T01:35:41.851ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54372024-11-08T01:35:41.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
54382024-11-08T01:35:41.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54392024-11-08T01:35:41.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54402024-11-08T01:35:41.863ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 588.838364ms iteration = 29 status = {"physical_disks_added":0}
54412024-11-08T01:35:41.926ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54422024-11-08T01:35:41.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54432024-11-08T01:35:41.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54442024-11-08T01:35:41.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54462024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54472024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54482024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54492024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54502024-11-08T01:35:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54512024-11-08T01:35:41.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-11-08T01:35:41.933ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 5a2b09e7-4e48-40fd-b4d6-fd1bd29cd7ff dns_zone_name = oxide.test found_so_far = 1 version = 2
54532024-11-08T01:35:41.933ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54542024-11-08T01:35:41.933ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-08 01:24:22.290314 UTC dns_group = external generation = 2
54552024-11-08T01:35:41.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 658.600003ms iteration = 14 status = {"generation":2}
54562024-11-08T01:35:41.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54572024-11-08T01:35:41.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54582024-11-08T01:35:41.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54592024-11-08T01:35:42.028ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2e38ed4-2b25-452f-b81d-4acec59fd855", "content-length": "583", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
54602024-11-08T01:35:42.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54612024-11-08T01:35:42.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54622024-11-08T01:35:42.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54632024-11-08T01:35:42.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54642024-11-08T01:35:42.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "594af7c7-283c-4292-8eee-459304287246", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54652024-11-08T01:35:42.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54662024-11-08T01:35:42.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a13ac51-8859-44b4-825f-f56a8848857e", "content-length": "810", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
54672024-11-08T01:35:42.041ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(2933224) }} sled = sock
54682024-11-08T01:35:42.041ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54692024-11-08T01:35:42.041ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54702024-11-08T01:35:42.043ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 768.425057ms iteration = 25 status = {}
54712024-11-08T01:35:42.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "043805d1-37ce-4c3a-a184-5673a29db864", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54722024-11-08T01:35:42.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54732024-11-08T01:35:42.045ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f3a4156a-3a99-4b44-86d9-42bf712ecafa", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54742024-11-08T01:35:42.045ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54752024-11-08T01:35:42.047ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
54762024-11-08T01:35:42.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 772.552173ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54772024-11-08T01:35:42.071ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {48b753b5-a154-47e4-b02c-e1782b50b1b9: {10.151.2.176: {b105306e-bff7-4368-9215-064a6b20f4e5}, 10.151.2.175: {b105306e-bff7-4368-9215-064a6b20f4e5}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54782024-11-08T01:35:42.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54792024-11-08T01:35:42.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "526cce27-47c7-499b-9519-29ddc1a638eb", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
54802024-11-08T01:35:42.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54812024-11-08T01:35:42.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54822024-11-08T01:35:42.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54832024-11-08T01:35:42.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54842024-11-08T01:35:42.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54852024-11-08T01:35:42.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54862024-11-08T01:35:42.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54872024-11-08T01:35:42.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54882024-11-08T01:35:42.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54892024-11-08T01:35:42.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54902024-11-08T01:35:42.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54912024-11-08T01:35:42.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54922024-11-08T01:35:42.090ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54932024-11-08T01:35:42.090ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54942024-11-08T01:35:42.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54952024-11-08T01:35:42.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d08ab92-a71c-4277-8058-eb4aee3f1523", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
54962024-11-08T01:35:42.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 818.092245ms iteration = 26 status = {}
54972024-11-08T01:35:42.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54982024-11-08T01:35:42.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54992024-11-08T01:35:42.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
55002024-11-08T01:35:42.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55012024-11-08T01:35:42.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55022024-11-08T01:35:42.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55032024-11-08T01:35:42.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "861b1bfd-7877-4038-8a83-4de2ce2ef30e", "content-length": "134", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
55042024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55052024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
55062024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55072024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55082024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55092024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55102024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55112024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55122024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55132024-11-08T01:35:42.115ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55142024-11-08T01:35:42.116ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
55152024-11-08T01:35:42.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55162024-11-08T01:35:42.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55172024-11-08T01:35:42.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55182024-11-08T01:35:42.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7021432-5676-4db1-be89-6857e6ab5a71", "content-length": "2", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
55192024-11-08T01:35:42.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55202024-11-08T01:35:42.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb40d4b-435f-42d2-b725-efa491d5b935", "content-length": "52", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
55212024-11-08T01:35:42.118ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
55222024-11-08T01:35:42.118ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55232024-11-08T01:35:42.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5e96704c-12d2-402b-86de-9d3bc09823f2", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
55242024-11-08T01:35:42.226ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
55252024-11-08T01:35:42.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55262024-11-08T01:35:42.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ed9cb3a0-fdc3-4fcc-ace3-b80a7dd8ff87 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
55272024-11-08T01:35:42.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ed9cb3a0-fdc3-4fcc-ace3-b80a7dd8ff87 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
55282024-11-08T01:35:42.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33efc095-4cec-4fd7-82ea-9710af64bb99", "content-length": "682", "date": "Fri, 08 Nov 2024 01:35:42 GMT"} })
55292024-11-08T01:35:42.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55302024-11-08T01:35:42.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55312024-11-08T01:35:42.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ed9cb3a0-fdc3-4fcc-ace3-b80a7dd8ff87 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
55322024-11-08T01:35:42.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55332024-11-08T01:35:42.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55342024-11-08T01:35:42.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55352024-11-08T01:35:42.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55362024-11-08T01:35:42.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55372024-11-08T01:35:42.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55382024-11-08T01:35:42.243ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 968.391465ms iteration = 25 status = {}
55392024-11-08T01:35:42.294ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-08T01:35:42.293764477Z }
55402024-11-08T01:35:42.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55412024-11-08T01:35:42.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55422024-11-08T01:35:42.329ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_needs_update = true
55432024-11-08T01:35:42.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55442024-11-08T01:35:42.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55452024-11-08T01:35:42.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55462024-11-08T01:35:42.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55472024-11-08T01:35:42.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55482024-11-08T01:35:42.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55492024-11-08T01:35:42.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55502024-11-08T01:35:42.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55512024-11-08T01:35:42.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55522024-11-08T01:35:42.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55532024-11-08T01:35:42.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55542024-11-08T01:35:42.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55552024-11-08T01:35:42.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55562024-11-08T01:35:42.369ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e8022873-0d52-4c5d-be7f-834a19a05c7d, lookup_type: ById(e8022873-0d52-4c5d-be7f-834a19a05c7d) }, key: d68bcf02-1500-4ad8-a735-e369fe7a9175, lookup_type: ById(d68bcf02-1500-4ad8-a735-e369fe7a9175) }, key: 6868d009-f608-4ad1-8284-b70dc5e246d3, lookup_type: ById(6868d009-f608-4ad1-8284-b70dc5e246d3) } result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55572024-11-08T01:35:42.369ZINFOnexus (dropshot_internal): starting update saga for 6868d009-f608-4ad1-8284-b70dc5e246d3 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-08T01:35:42.293764477Z }
55582024-11-08T01:35:42.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75804 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 response_code = 204 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55592024-11-08T01:35:42.370ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 53227d20-b446-453d-bfff-35f2dfab7198 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-08T01:35:42.293764477Z }
55602024-11-08T01:35:42.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 53227d20-b446-453d-bfff-35f2dfab7198 roles = RoleSet { roles: {} } uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55612024-11-08T01:35:42.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 53227d20-b446-453d-bfff-35f2dfab7198 resource = Database result = Ok(()) uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55622024-11-08T01:35:42.372ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6868d009-f608-4ad1-8284-b70dc5e246d3... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 24d4dbf6-393b-4e93-8db2-bf6662ce9f29 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55632024-11-08T01:35:42.372ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update
55642024-11-08T01:35:42.372ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6868d009-f608-4ad1-8284-b70dc5e246d3","lookup_type":{"ById":"6868d009-f608-4ad1-8284-b70dc5e246d3"},"parent":{"key":"d68bcf02-1500-4ad8-a735-e369fe7a9175","lookup_type":{"ById":"d68bcf02-1500-4ad8-a735-e369fe7a9175"},"parent":{"key":"e8022873-0d52-4c5d-be7f-834a19a05c7d","lookup_type":{"ById":"e8022873-0d52-4c5d-be7f-834a19a05c7d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55652024-11-08T01:35:42.372ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update
55662024-11-08T01:35:42.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6418 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 53227d20-b446-453d-bfff-35f2dfab7198 response_code = 204 uri = /vmms/7b6d8997-9b24-486b-b46a-9c6931d94664
55672024-11-08T01:35:42.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/7b6d8997-9b24-486b-b46a-9c6931d94664/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "814b81ba-f3f5-44f2-a3e3-60c99cd591a0", "content-length": "132", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
55682024-11-08T01:35:42.380ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 sled_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-08T01:35:42.293764477Z }, migration_in: None, migration_out: None } vmm_id = 7b6d8997-9b24-486b-b46a-9c6931d94664
55692024-11-08T01:35:42.380ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 sled_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d vmm_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-08T01:35:42.293764477Z }
55702024-11-08T01:35:42.380ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 roles = RoleSet { roles: {} } sled_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d vmm_id = 7b6d8997-9b24-486b-b46a-9c6931d94664
55712024-11-08T01:35:42.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 resource = Database result = Ok(()) sled_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d vmm_id = 7b6d8997-9b24-486b-b46a-9c6931d94664
55722024-11-08T01:35:42.412ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update
55732024-11-08T01:35:42.412ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55742024-11-08T01:35:42.412ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55752024-11-08T01:35:42.412ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
55762024-11-08T01:35:42.415ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55772024-11-08T01:35:42.415ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
55782024-11-08T01:35:42.419ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55792024-11-08T01:35:42.419ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
55802024-11-08T01:35:42.421ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
55812024-11-08T01:35:42.422ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55822024-11-08T01:35:42.422ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a9662971-dc55-40e7-8075-bb8bf20be0a7")) node_id = 0 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
55832024-11-08T01:35:42.423ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.148186832s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"destroyed":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
55842024-11-08T01:35:42.425ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
55852024-11-08T01:35:42.425ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
55862024-11-08T01:35:42.433ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update
55872024-11-08T01:35:42.433ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55882024-11-08T01:35:42.434ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55892024-11-08T01:35:42.436ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55902024-11-08T01:35:42.436ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55912024-11-08T01:35:42.437ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55922024-11-08T01:35:42.437ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55932024-11-08T01:35:42.439ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55942024-11-08T01:35:42.439ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55952024-11-08T01:35:42.440ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55962024-11-08T01:35:42.441ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55972024-11-08T01:35:42.442ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55982024-11-08T01:35:42.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
55992024-11-08T01:35:42.443ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56002024-11-08T01:35:42.447ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e8022873-0d52-4c5d-be7f-834a19a05c7d, lookup_type: ById(e8022873-0d52-4c5d-be7f-834a19a05c7d) }, key: d68bcf02-1500-4ad8-a735-e369fe7a9175, lookup_type: ById(d68bcf02-1500-4ad8-a735-e369fe7a9175) }, key: 6868d009-f608-4ad1-8284-b70dc5e246d3, lookup_type: ById(6868d009-f608-4ad1-8284-b70dc5e246d3) } result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56012024-11-08T01:35:42.447ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance updater_id = a9662971-dc55-40e7-8075-bb8bf20be0a7
56022024-11-08T01:35:42.447ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56032024-11-08T01:35:42.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56042024-11-08T01:35:42.456ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance updater_id = a9662971-dc55-40e7-8075-bb8bf20be0a7
56052024-11-08T01:35:42.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56062024-11-08T01:35:42.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance
56072024-11-08T01:35:42.461ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 locked_gen = Generation(Generation(2)) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = LockInstance updater_id = a9662971-dc55-40e7-8075-bb8bf20be0a7
56082024-11-08T01:35:42.463ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56092024-11-08T01:35:42.463ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a9662971-dc55-40e7-8075-bb8bf20be0a7")}) node_id = 1 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
56102024-11-08T01:35:42.466ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56112024-11-08T01:35:42.466ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
56122024-11-08T01:35:42.472ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56132024-11-08T01:35:42.472ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56142024-11-08T01:35:42.474ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56152024-11-08T01:35:42.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56162024-11-08T01:35:42.475ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56172024-11-08T01:35:42.475ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56182024-11-08T01:35:42.476ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56192024-11-08T01:35:42.479ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e8022873-0d52-4c5d-be7f-834a19a05c7d, lookup_type: ById(e8022873-0d52-4c5d-be7f-834a19a05c7d) }, key: d68bcf02-1500-4ad8-a735-e369fe7a9175, lookup_type: ById(d68bcf02-1500-4ad8-a735-e369fe7a9175) }, key: 6868d009-f608-4ad1-8284-b70dc5e246d3, lookup_type: ById(6868d009-f608-4ad1-8284-b70dc5e246d3) } result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56202024-11-08T01:35:42.479ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56212024-11-08T01:35:42.480ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
56222024-11-08T01:35:42.487ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 7b6d8997-9b24-486b-b46a-9c6931d94664, time_created: 2024-11-08T01:35:21.488467Z, time_deleted: None, instance_id: 6868d009-f608-4ad1-8284-b70dc5e246d3, sled_id: 979cd0c3-718d-49ed-b7c9-9ea81462754d, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-08T01:35:42.293764Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-08T01:35:19.252444Z, gen: Generation(Generation(3)), propolis_id: Some(7b6d8997-9b24-486b-b46a-9c6931d94664), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(7b6d8997-9b24-486b-b46a-9c6931d94664 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-08T01:35:42.487663603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
56232024-11-08T01:35:42.487ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56242024-11-08T01:35:42.487ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6868d009-f608-4ad1-8284-b70dc5e246d3","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"7b6d8997-9b24-486b-b46a-9c6931d94664"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6868d009-f608-4ad1-8284-b70dc5e246d3","lookup_type":{"ById":"6868d009-f608-4ad1-8284-b70dc5e246d3"},"parent":{"key":"d68bcf02-1500-4ad8-a735-e369fe7a9175","lookup_type":{"ById":"d68bcf02-1500-4ad8-a735-e369fe7a9175"},"parent":{"key":"e8022873-0d52-4c5d-be7f-834a19a05c7d","lookup_type":{"ById":"e8022873-0d52-4c5d-be7f-834a19a05c7d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"a9662971-dc55-40e7-8075-bb8bf20be0a7"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"d68bcf02-1500-4ad8-a735-e369fe7a9175","ram_diff":1073741824},"destroy_active_vmm":"7b6d8997-9b24-486b-b46a-9c6931d94664","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-08T01:35:42.487663603Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56252024-11-08T01:35:42.487ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56262024-11-08T01:35:42.519ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56272024-11-08T01:35:42.519ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56282024-11-08T01:35:42.519ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56292024-11-08T01:35:42.519ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56302024-11-08T01:35:42.524ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56312024-11-08T01:35:42.524ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56322024-11-08T01:35:42.527ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56332024-11-08T01:35:42.527ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56342024-11-08T01:35:42.533ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56352024-11-08T01:35:42.533ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f")) node_id = 0 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56362024-11-08T01:35:42.537ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56372024-11-08T01:35:42.537ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56382024-11-08T01:35:42.543ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 parent_lock = UpdaterLock { updater_id: a9662971-dc55-40e7-8075-bb8bf20be0a7, locked_gen: Generation(Generation(2)) } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56392024-11-08T01:35:42.543ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = BecomeUpdater
56402024-11-08T01:35:42.543ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = BecomeUpdater
56412024-11-08T01:35:42.554ZDEBGnexus (SagaExecutor): inherited lock from a9662971-dc55-40e7-8075-bb8bf20be0a7 to b50a7084-0aa6-4d2e-8273-ccd35281cb1f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = a9662971-dc55-40e7-8075-bb8bf20be0a7 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = BecomeUpdater updater_id = b50a7084-0aa6-4d2e-8273-ccd35281cb1f
56422024-11-08T01:35:42.554ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56432024-11-08T01:35:42.554ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56442024-11-08T01:35:42.554ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f")}) node_id = 1 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56452024-11-08T01:35:42.556ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56462024-11-08T01:35:42.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56472024-11-08T01:35:42.560ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56482024-11-08T01:35:42.560ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56492024-11-08T01:35:42.563ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56502024-11-08T01:35:42.563ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56512024-11-08T01:35:42.569ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56522024-11-08T01:35:42.571ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3
56532024-11-08T01:35:42.574ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56542024-11-08T01:35:42.574ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56552024-11-08T01:35:42.577ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56562024-11-08T01:35:42.577ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56572024-11-08T01:35:42.581ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
56582024-11-08T01:35:42.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56592024-11-08T01:35:42.581ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UpdateNetworkConfig
56602024-11-08T01:35:42.584ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
56612024-11-08T01:35:42.584ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
56622024-11-08T01:35:42.584ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
56632024-11-08T01:35:42.586ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
56642024-11-08T01:35:42.587ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
56652024-11-08T01:35:42.587ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
56662024-11-08T01:35:42.587ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
56672024-11-08T01:35:42.595ZDEBGnexus: notifying dendrite of updates instance_id = Some(6868d009-f608-4ad1-8284-b70dc5e246d3 (instance)) switch = switch0
56682024-11-08T01:35:42.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2142, tv_nsec: 805359527 } })
56692024-11-08T01:35:42.596ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
56702024-11-08T01:35:42.626ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
56712024-11-08T01:35:42.626ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56722024-11-08T01:35:42.626ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcab0c84-17b7-441c-8c47-9504abb525cd", "content-length": "26", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
56732024-11-08T01:35:42.626ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56742024-11-08T01:35:42.627ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56752024-11-08T01:35:42.657ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
56762024-11-08T01:35:42.657ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "19969e44-8fd4-4f16-8b95-0b10adc2bc7e", "content-length": "4", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
56772024-11-08T01:35:42.659ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56782024-11-08T01:35:42.659ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56792024-11-08T01:35:42.663ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56802024-11-08T01:35:42.663ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56812024-11-08T01:35:42.666ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
56822024-11-08T01:35:42.666ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
56832024-11-08T01:35:42.679ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-08T01:35:42.669474Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: d68bcf02-1500-4ad8-a735-e369fe7a9175, time_modified: Some(2024-11-08T01:35:42.669474Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e8022873-0d52-4c5d-be7f-834a19a05c7d, time_modified: Some(2024-11-08T01:35:42.669474Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56842024-11-08T01:35:42.679ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56852024-11-08T01:35:42.679ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56862024-11-08T01:35:42.683ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56872024-11-08T01:35:42.683ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
56882024-11-08T01:35:42.687ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56892024-11-08T01:35:42.687ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UnassignOximeterProducer
56902024-11-08T01:35:42.687ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UnassignOximeterProducer
56912024-11-08T01:35:42.695ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d producer_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56922024-11-08T01:35:42.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UnassignOximeterProducer
56932024-11-08T01:35:42.695ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = UnassignOximeterProducer
56942024-11-08T01:35:42.729ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56952024-11-08T01:35:42.732ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6868d009-f608-4ad1-8284-b70dc5e246d3
56962024-11-08T01:35:42.744ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6868d009-f608-4ad1-8284-b70dc5e246d3 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6868d009-f608-4ad1-8284-b70dc5e246d3", status: 204, headers: {"x-request-id": "8791213e-7acc-4f7c-b1ca-5288d4bc56a4", "date": "Fri, 08 Nov 2024 01:35:42 GMT"} }) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56972024-11-08T01:35:42.744ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d producer_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
56982024-11-08T01:35:42.745ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
56992024-11-08T01:35:42.745ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57002024-11-08T01:35:42.750ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57012024-11-08T01:35:42.750ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57022024-11-08T01:35:42.755ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 lock = UpdaterLock { updater_id: b50a7084-0aa6-4d2e-8273-ccd35281cb1f, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-08T01:35:42.487663603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
57032024-11-08T01:35:42.755ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = CommitInstanceUpdates
57042024-11-08T01:35:42.756ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = CommitInstanceUpdates
57052024-11-08T01:35:42.789ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 new_runtime = InstanceRuntimeState { time_updated: 2024-11-08T01:35:42.487663603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
57062024-11-08T01:35:42.789ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57072024-11-08T01:35:42.789ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57082024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
57092024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
57102024-11-08T01:35:42.789ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57112024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57122024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57132024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57142024-11-08T01:35:42.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57152024-11-08T01:35:42.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-11-08T01:35:42.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57172024-11-08T01:35:42.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57182024-11-08T01:35:42.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57192024-11-08T01:35:42.793ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57202024-11-08T01:35:42.793ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57212024-11-08T01:35:42.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57222024-11-08T01:35:42.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57232024-11-08T01:35:42.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57242024-11-08T01:35:42.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57252024-11-08T01:35:42.797ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57262024-11-08T01:35:42.797ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6868d009-f608-4ad1-8284-b70dc5e246d3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("7b6d8997-9b24-486b-b46a-9c6931d94664")}) node_id = 7 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57272024-11-08T01:35:42.799ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57282024-11-08T01:35:42.799ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57292024-11-08T01:35:42.803ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57302024-11-08T01:35:42.803ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57312024-11-08T01:35:42.806ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57322024-11-08T01:35:42.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57332024-11-08T01:35:42.809ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
57342024-11-08T01:35:42.809ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ReleaseSledResources
57352024-11-08T01:35:42.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ReleaseSledResources
57362024-11-08T01:35:42.828ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57372024-11-08T01:35:42.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57382024-11-08T01:35:42.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "389096f8-045e-4fe9-a06d-1fdd9d3a5cf7", "content-length": "372", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
57392024-11-08T01:35:42.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57402024-11-08T01:35:42.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57412024-11-08T01:35:42.833ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57422024-11-08T01:35:42.833ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57432024-11-08T01:35:42.836ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57442024-11-08T01:35:42.836ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57452024-11-08T01:35:42.839ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 propolis_id = 7b6d8997-9b24-486b-b46a-9c6931d94664 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
57462024-11-08T01:35:42.839ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = MarkVmmDeleted
57472024-11-08T01:35:42.840ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = MarkVmmDeleted
57482024-11-08T01:35:42.847ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57492024-11-08T01:35:42.847ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57502024-11-08T01:35:42.851ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57512024-11-08T01:35:42.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57522024-11-08T01:35:42.858ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57532024-11-08T01:35:42.858ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57542024-11-08T01:35:42.861ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57552024-11-08T01:35:42.862ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57562024-11-08T01:35:42.865ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57572024-11-08T01:35:42.866ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57582024-11-08T01:35:42.870ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57592024-11-08T01:35:42.870ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57602024-11-08T01:35:42.871ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57612024-11-08T01:35:42.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57622024-11-08T01:35:42.873ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57632024-11-08T01:35:42.876ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e8022873-0d52-4c5d-be7f-834a19a05c7d, lookup_type: ById(e8022873-0d52-4c5d-be7f-834a19a05c7d) }, key: d68bcf02-1500-4ad8-a735-e369fe7a9175, lookup_type: ById(d68bcf02-1500-4ad8-a735-e369fe7a9175) }, key: 6868d009-f608-4ad1-8284-b70dc5e246d3, lookup_type: ById(6868d009-f608-4ad1-8284-b70dc5e246d3) } result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57642024-11-08T01:35:42.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57652024-11-08T01:35:42.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_node = ChainSuccessorSaga
57662024-11-08T01:35:42.882ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {48b753b5-a154-47e4-b02c-e1782b50b1b9: {10.151.2.175: {b105306e-bff7-4368-9215-064a6b20f4e5}, 10.151.2.176: {b105306e-bff7-4368-9215-064a6b20f4e5}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57672024-11-08T01:35:42.882ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57682024-11-08T01:35:42.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e6773766-b65d-411a-a24a-e01b30d977d5", "date": "Fri, 08 Nov 2024 01:35:41 GMT"} })
57692024-11-08T01:35:42.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57702024-11-08T01:35:42.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57712024-11-08T01:35:42.884ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update
57722024-11-08T01:35:42.884ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57732024-11-08T01:35:42.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57742024-11-08T01:35:42.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57752024-11-08T01:35:42.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57762024-11-08T01:35:42.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57772024-11-08T01:35:42.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57782024-11-08T01:35:42.887ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57792024-11-08T01:35:42.887ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57802024-11-08T01:35:42.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57812024-11-08T01:35:42.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57822024-11-08T01:35:42.891ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57832024-11-08T01:35:42.891ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57842024-11-08T01:35:42.891ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57852024-11-08T01:35:42.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57862024-11-08T01:35:42.891ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "34f10e9b-6bc4-44aa-bf22-6a174dc0a58f", "date": "Fri, 08 Nov 2024 01:35:42 GMT"} })
57872024-11-08T01:35:42.893ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 104.044139ms iteration = 27 status = {}
57882024-11-08T01:35:42.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57892024-11-08T01:35:42.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57902024-11-08T01:35:42.894ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
57912024-11-08T01:35:42.894ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7
57922024-11-08T01:35:42.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57932024-11-08T01:35:42.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57942024-11-08T01:35:42.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57952024-11-08T01:35:42.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57962024-11-08T01:35:42.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57972024-11-08T01:35:42.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57982024-11-08T01:35:42.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57992024-11-08T01:35:42.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58002024-11-08T01:35:42.928ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58012024-11-08T01:35:42.928ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 saga_name = instance-update saga_result = SagaResult { saga_id: 5fa62fa6-6656-4ed3-bf73-47007d95d1c7, saga_log: SagaLog { saga_id: 5fa62fa6-6656-4ed3-bf73-47007d95d1c7, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6868d009-f608-4ad1-8284-b70dc5e246d3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("7b6d8997-9b24-486b-b46a-9c6931d94664")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6868d009-f608-4ad1-8284-b70dc5e246d3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("7b6d8997-9b24-486b-b46a-9c6931d94664")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("b50a7084-0aa6-4d2e-8273-ccd35281cb1f")}} }) }
58022024-11-08T01:35:42.928ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 5fa62fa6-6656-4ed3-bf73-47007d95d1c7 instance_id = 6868d009-f608-4ad1-8284-b70dc5e246d3 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update
58032024-11-08T01:35:42.928ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58042024-11-08T01:35:42.928ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
58052024-11-08T01:35:42.932ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58062024-11-08T01:35:42.932ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
58072024-11-08T01:35:42.932ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58082024-11-08T01:35:42.932ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d6e0511-e2ae-4a13-99a7-0006f45c0fca", "content-length": "691", "date": "Fri, 08 Nov 2024 01:35:42 GMT"} })
58092024-11-08T01:35:42.932ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58102024-11-08T01:35:42.933ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58112024-11-08T01:35:42.933ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58122024-11-08T01:35:42.935ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 145.8374ms iteration = 26 status = {}
58132024-11-08T01:35:42.936ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58142024-11-08T01:35:42.936ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
58152024-11-08T01:35:42.939ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58162024-11-08T01:35:42.939ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810
58172024-11-08T01:35:42.970ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update sec_id = 342fecfa-d739-42a3-a354-8b70b3c745ce
58182024-11-08T01:35:42.970ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b182bc73-6412-4f3e-b4f2-b2a89aa90810 saga_name = start-instance-update saga_result = SagaResult { saga_id: b182bc73-6412-4f3e-b4f2-b2a89aa90810, saga_log: SagaLog { saga_id: b182bc73-6412-4f3e-b4f2-b2a89aa90810, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("a9662971-dc55-40e7-8075-bb8bf20be0a7")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a9662971-dc55-40e7-8075-bb8bf20be0a7")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("a9662971-dc55-40e7-8075-bb8bf20be0a7"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("a9662971-dc55-40e7-8075-bb8bf20be0a7")}} }) }
58192024-11-08T01:35:43.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ef0de4c5-e066-4bde-9278-5eea87a624bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58202024-11-08T01:35:43.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ef0de4c5-e066-4bde-9278-5eea87a624bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58212024-11-08T01:35:43.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e274e866-8bad-4f19-98cc-84d19a1b6c78 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58222024-11-08T01:35:43.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e274e866-8bad-4f19-98cc-84d19a1b6c78 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58232024-11-08T01:35:43.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = ef0de4c5-e066-4bde-9278-5eea87a624bf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58242024-11-08T01:35:43.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e274e866-8bad-4f19-98cc-84d19a1b6c78 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58252024-11-08T01:35:44.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 45624a28-308d-4266-8961-68d24d603e36 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58262024-11-08T01:35:44.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 45624a28-308d-4266-8961-68d24d603e36 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58272024-11-08T01:35:44.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 45624a28-308d-4266-8961-68d24d603e36 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58282024-11-08T01:35:44.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37ffc1cc-169c-4c68-b8b3-d5a8a71b2777 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58292024-11-08T01:35:44.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37ffc1cc-169c-4c68-b8b3-d5a8a71b2777 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58302024-11-08T01:35:44.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 37ffc1cc-169c-4c68-b8b3-d5a8a71b2777 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58312024-11-08T01:35:45.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 7c788e7c-6e4b-4b76-bae8-cd20be1f6897 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
58322024-11-08T01:35:45.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28e21df5-320e-4467-a6b3-5eaf5025b3c1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58332024-11-08T01:35:45.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28e21df5-320e-4467-a6b3-5eaf5025b3c1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58342024-11-08T01:35:45.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 28e21df5-320e-4467-a6b3-5eaf5025b3c1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58352024-11-08T01:35:46.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e37af0f0-eeb7-464a-9769-f369958cb7d1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58362024-11-08T01:35:46.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e37af0f0-eeb7-464a-9769-f369958cb7d1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58372024-11-08T01:35:46.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e37af0f0-eeb7-464a-9769-f369958cb7d1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58382024-11-08T01:35:47.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcb79acc-396e-496b-8535-583783226e7f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58392024-11-08T01:35:47.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcb79acc-396e-496b-8535-583783226e7f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58402024-11-08T01:35:47.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcb79acc-396e-496b-8535-583783226e7f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58412024-11-08T01:35:48.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ef79d54-70d8-4950-9aed-8fe325152eb1 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58422024-11-08T01:35:48.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ef79d54-70d8-4950-9aed-8fe325152eb1 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58432024-11-08T01:35:48.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7ef79d54-70d8-4950-9aed-8fe325152eb1 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58442024-11-08T01:35:49.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7c5d2b6-8dd9-4f96-81a0-8275a643bda8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58452024-11-08T01:35:49.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7c5d2b6-8dd9-4f96-81a0-8275a643bda8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58462024-11-08T01:35:49.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = a7c5d2b6-8dd9-4f96-81a0-8275a643bda8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58472024-11-08T01:35:50.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe4cc8d-4853-4257-a246-4f89f541e947 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58482024-11-08T01:35:50.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe4cc8d-4853-4257-a246-4f89f541e947 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58492024-11-08T01:35:50.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 3fe4cc8d-4853-4257-a246-4f89f541e947 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58502024-11-08T01:35:51.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
58512024-11-08T01:35:51.274ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
58522024-11-08T01:35:51.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58532024-11-08T01:35:51.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58542024-11-08T01:35:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58552024-11-08T01:35:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58562024-11-08T01:35:51.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58572024-11-08T01:35:51.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58582024-11-08T01:35:51.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58592024-11-08T01:35:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58602024-11-08T01:35:51.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58612024-11-08T01:35:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58622024-11-08T01:35:51.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58632024-11-08T01:35:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58642024-11-08T01:35:51.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58652024-11-08T01:35:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
58662024-11-08T01:35:51.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58672024-11-08T01:35:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58682024-11-08T01:35:51.293ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
58692024-11-08T01:35:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.127773ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
58702024-11-08T01:35:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.659949ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58712024-11-08T01:35:51.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 70e1b081-205e-4766-b0a2-ad69bfb85c7c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58722024-11-08T01:35:51.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 70e1b081-205e-4766-b0a2-ad69bfb85c7c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58732024-11-08T01:35:51.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 70e1b081-205e-4766-b0a2-ad69bfb85c7c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58742024-11-08T01:35:52.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4e56f81-eed6-4466-81d4-e4a539b98811 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58752024-11-08T01:35:52.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4e56f81-eed6-4466-81d4-e4a539b98811 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58762024-11-08T01:35:52.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c4e56f81-eed6-4466-81d4-e4a539b98811 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58772024-11-08T01:35:53.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 150da518-808d-4cd2-8ebd-98b5efdaa53c roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58782024-11-08T01:35:53.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 150da518-808d-4cd2-8ebd-98b5efdaa53c resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58792024-11-08T01:35:53.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 150da518-808d-4cd2-8ebd-98b5efdaa53c response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58802024-11-08T01:35:54.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd028032-b306-436c-8ea6-f8f4636fb886 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58812024-11-08T01:35:54.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd028032-b306-436c-8ea6-f8f4636fb886 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58822024-11-08T01:35:54.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bd028032-b306-436c-8ea6-f8f4636fb886 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58832024-11-08T01:35:55.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7af78ab3-2dc6-4075-a04a-a283d51b6de2 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58842024-11-08T01:35:55.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7af78ab3-2dc6-4075-a04a-a283d51b6de2 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58852024-11-08T01:35:55.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7af78ab3-2dc6-4075-a04a-a283d51b6de2 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58862024-11-08T01:35:56.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c3ac63df-a58d-4860-a0b3-47e48a6c732e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58872024-11-08T01:35:56.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c3ac63df-a58d-4860-a0b3-47e48a6c732e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58882024-11-08T01:35:56.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = c3ac63df-a58d-4860-a0b3-47e48a6c732e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58892024-11-08T01:35:57.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 632200c8-305a-4f98-9940-b62dad395057 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58902024-11-08T01:35:57.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 632200c8-305a-4f98-9940-b62dad395057 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58912024-11-08T01:35:57.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 632200c8-305a-4f98-9940-b62dad395057 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58922024-11-08T01:35:58.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dd1be674-2bda-42a1-8351-e7609ff4cf0a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58932024-11-08T01:35:58.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dd1be674-2bda-42a1-8351-e7609ff4cf0a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58942024-11-08T01:35:58.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = dd1be674-2bda-42a1-8351-e7609ff4cf0a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58952024-11-08T01:35:59.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 032e3265-ccca-4acf-b179-985df5a2258f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58962024-11-08T01:35:59.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 032e3265-ccca-4acf-b179-985df5a2258f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58972024-11-08T01:35:59.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 032e3265-ccca-4acf-b179-985df5a2258f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
58982024-11-08T01:36:00.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 6850c212-4b2f-4e16-82bd-4e2fd41fd2b7 response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
58992024-11-08T01:36:00.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7b33c518-b460-40f4-82e4-d8df123aa262 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59002024-11-08T01:36:00.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7b33c518-b460-40f4-82e4-d8df123aa262 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59012024-11-08T01:36:00.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7b33c518-b460-40f4-82e4-d8df123aa262 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59022024-11-08T01:36:01.274ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
59032024-11-08T01:36:01.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
59042024-11-08T01:36:01.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59052024-11-08T01:36:01.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59062024-11-08T01:36:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59072024-11-08T01:36:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59082024-11-08T01:36:01.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59092024-11-08T01:36:01.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59102024-11-08T01:36:01.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59112024-11-08T01:36:01.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59122024-11-08T01:36:01.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59132024-11-08T01:36:01.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59142024-11-08T01:36:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59152024-11-08T01:36:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59162024-11-08T01:36:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172024-11-08T01:36:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
59182024-11-08T01:36:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59192024-11-08T01:36:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59202024-11-08T01:36:01.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
59212024-11-08T01:36:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.159011ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
59222024-11-08T01:36:01.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.676829ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59232024-11-08T01:36:01.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d95f9428-1ea3-461c-a0e1-366784bbc7d4 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59242024-11-08T01:36:01.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d95f9428-1ea3-461c-a0e1-366784bbc7d4 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59252024-11-08T01:36:01.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d95f9428-1ea3-461c-a0e1-366784bbc7d4 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59262024-11-08T01:36:02.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1286f856-c293-4922-8f72-9b961fa4aea3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59272024-11-08T01:36:02.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1286f856-c293-4922-8f72-9b961fa4aea3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59282024-11-08T01:36:02.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1286f856-c293-4922-8f72-9b961fa4aea3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59292024-11-08T01:36:03.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e801e2e5-65df-4132-b690-169b1d786531 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59302024-11-08T01:36:03.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e801e2e5-65df-4132-b690-169b1d786531 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59312024-11-08T01:36:03.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e801e2e5-65df-4132-b690-169b1d786531 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59322024-11-08T01:36:04.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82547025-b198-4a1a-affc-d0e72d701e11 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59332024-11-08T01:36:04.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82547025-b198-4a1a-affc-d0e72d701e11 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59342024-11-08T01:36:04.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82547025-b198-4a1a-affc-d0e72d701e11 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59352024-11-08T01:36:05.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bdeeb04-467a-4476-ac20-1ab7de42332e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59362024-11-08T01:36:05.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bdeeb04-467a-4476-ac20-1ab7de42332e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59372024-11-08T01:36:05.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 4bdeeb04-467a-4476-ac20-1ab7de42332e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59382024-11-08T01:36:06.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef816061-807a-4eed-b8fd-d7b1bdcd52d5 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59392024-11-08T01:36:06.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef816061-807a-4eed-b8fd-d7b1bdcd52d5 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59402024-11-08T01:36:06.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = ef816061-807a-4eed-b8fd-d7b1bdcd52d5 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59412024-11-08T01:36:07.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b72ed71-6391-489e-8b03-b181c792c1bf roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59422024-11-08T01:36:07.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b72ed71-6391-489e-8b03-b181c792c1bf resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59432024-11-08T01:36:07.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1b72ed71-6391-489e-8b03-b181c792c1bf response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59442024-11-08T01:36:08.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2e2c3bb9-e2f7-4fc2-bace-b1a170aded9e roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59452024-11-08T01:36:08.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2e2c3bb9-e2f7-4fc2-bace-b1a170aded9e resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59462024-11-08T01:36:08.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 2e2c3bb9-e2f7-4fc2-bace-b1a170aded9e response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59472024-11-08T01:36:09.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7443be54-73d8-4f07-8dfa-7caf02c0fb49 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59482024-11-08T01:36:09.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7443be54-73d8-4f07-8dfa-7caf02c0fb49 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59492024-11-08T01:36:09.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 7443be54-73d8-4f07-8dfa-7caf02c0fb49 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59502024-11-08T01:36:10.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 07aa1489-660d-4d99-a37b-4e3baaf5b005 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59512024-11-08T01:36:10.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 07aa1489-660d-4d99-a37b-4e3baaf5b005 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59522024-11-08T01:36:10.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 07aa1489-660d-4d99-a37b-4e3baaf5b005 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
59532024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
59542024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
59552024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59562024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
59572024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.74\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
59582024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
59592024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.53\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59602024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
59612024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.74\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59622024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
59632024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.08\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
59642024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
59652024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59662024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
59672024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
59682024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59692024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59702024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
59712024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59722024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
59732024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59742024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
59752024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762024-11-08T01:36:11.275ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59772024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
59782024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59792024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59802024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
59812024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59822024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
59832024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59842024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
59852024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59862024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
59872024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59882024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59892024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59902024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59912024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59922024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59932024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59942024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59952024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59962024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59972024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59982024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59992024-11-08T01:36:11.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60002024-11-08T01:36:11.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60012024-11-08T01:36:11.278ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2171, tv_nsec: 488244765 } })
60022024-11-08T01:36:11.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60032024-11-08T01:36:11.279ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
60042024-11-08T01:36:11.279ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.065505ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60052024-11-08T01:36:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60062024-11-08T01:36:11.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60072024-11-08T01:36:11.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60082024-11-08T01:36:11.281ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60092024-11-08T01:36:11.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60102024-11-08T01:36:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60112024-11-08T01:36:11.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60122024-11-08T01:36:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60132024-11-08T01:36:11.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60142024-11-08T01:36:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60152024-11-08T01:36:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60162024-11-08T01:36:11.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60172024-11-08T01:36:11.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60182024-11-08T01:36:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60192024-11-08T01:36:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60202024-11-08T01:36:11.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2171, tv_nsec: 496857110 } })
60212024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60222024-11-08T01:36:11.287ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60232024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60242024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60252024-11-08T01:36:11.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
60262024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60272024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60282024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60292024-11-08T01:36:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60302024-11-08T01:36:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60312024-11-08T01:36:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60322024-11-08T01:36:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60332024-11-08T01:36:11.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342024-11-08T01:36:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60352024-11-08T01:36:11.291ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60362024-11-08T01:36:11.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.33507ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
60372024-11-08T01:36:11.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382024-11-08T01:36:11.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60392024-11-08T01:36:11.292ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60402024-11-08T01:36:11.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60412024-11-08T01:36:11.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60422024-11-08T01:36:11.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60432024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60442024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60452024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60462024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60472024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60482024-11-08T01:36:11.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60492024-11-08T01:36:11.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60502024-11-08T01:36:11.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60512024-11-08T01:36:11.316ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60522024-11-08T01:36:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60532024-11-08T01:36:11.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 44.475258ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60542024-11-08T01:36:11.319ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60552024-11-08T01:36:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60562024-11-08T01:36:11.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60572024-11-08T01:36:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60582024-11-08T01:36:11.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60592024-11-08T01:36:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60602024-11-08T01:36:11.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612024-11-08T01:36:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60622024-11-08T01:36:11.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60632024-11-08T01:36:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60642024-11-08T01:36:11.333ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60652024-11-08T01:36:11.333ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60662024-11-08T01:36:11.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.276933ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60672024-11-08T01:36:11.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60682024-11-08T01:36:11.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
60692024-11-08T01:36:11.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60702024-11-08T01:36:11.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60712024-11-08T01:36:11.347ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.255932ms iteration = 30 status = {"physical_disks_added":0}
60722024-11-08T01:36:11.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.337059ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60732024-11-08T01:36:11.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
60742024-11-08T01:36:11.359ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60752024-11-08T01:36:11.359ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe4c5d2-a56a-460a-9eca-c2297b66a971", "content-length": "26", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
60762024-11-08T01:36:11.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60772024-11-08T01:36:11.362ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60782024-11-08T01:36:11.376ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
60792024-11-08T01:36:11.376ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60802024-11-08T01:36:11.376ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d16945be-6ac2-44c5-9bef-0ae8f6186f76", "content-length": "26", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
60812024-11-08T01:36:11.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60822024-11-08T01:36:11.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60832024-11-08T01:36:11.383ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60842024-11-08T01:36:11.383ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60852024-11-08T01:36:11.383ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "35dcb03b-6b96-4394-9b53-d7a569287e1b", "content-length": "372", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
60862024-11-08T01:36:11.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60872024-11-08T01:36:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60882024-11-08T01:36:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60892024-11-08T01:36:11.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-979cd0c3-718d-49ed-b7c9-9ea81462754d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2171, tv_nsec: 595654638 } })
60902024-11-08T01:36:11.386ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
60912024-11-08T01:36:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 979cd0c3-718d-49ed-b7c9-9ea81462754d, lookup_type: ById(979cd0c3-718d-49ed-b7c9-9ea81462754d) } result = Ok(())
60922024-11-08T01:36:11.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60932024-11-08T01:36:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60942024-11-08T01:36:11.391ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.224812ms iteration = 26 status = 0
60952024-11-08T01:36:11.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60962024-11-08T01:36:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60972024-11-08T01:36:11.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
60982024-11-08T01:36:11.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 123.783204ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
60992024-11-08T01:36:11.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61002024-11-08T01:36:11.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61012024-11-08T01:36:11.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61022024-11-08T01:36:11.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61032024-11-08T01:36:11.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61042024-11-08T01:36:11.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61052024-11-08T01:36:11.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61062024-11-08T01:36:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61072024-11-08T01:36:11.440ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61082024-11-08T01:36:11.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61092024-11-08T01:36:11.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "392b5edf-8e96-427c-923d-56e8748a6eda", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61102024-11-08T01:36:11.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61112024-11-08T01:36:11.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61122024-11-08T01:36:11.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61132024-11-08T01:36:11.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61142024-11-08T01:36:11.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61152024-11-08T01:36:11.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61162024-11-08T01:36:11.449ZINFOnexus (BackgroundTasks): VPC route manager sled 979cd0c3-718d-49ed-b7c9-9ea81462754d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61172024-11-08T01:36:11.449ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61182024-11-08T01:36:11.449ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3d49814e-1939-4287-8670-3493951219e5", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61192024-11-08T01:36:11.451ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 176.178258ms iteration = 28 status = {}
61202024-11-08T01:36:11.470ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.88504ms iteration = 26 status = {}
61212024-11-08T01:36:11.496ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61222024-11-08T01:36:11.496ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7162d174-f362-4160-817c-9919cd8bd169", "content-length": "2", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61232024-11-08T01:36:11.497ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61242024-11-08T01:36:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61252024-11-08T01:36:11.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 zone_address = fd00:1122:3344:101::2
61262024-11-08T01:36:11.498ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61272024-11-08T01:36:11.498ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05434425-e9fa-4bbb-ab48-4e0cd898a8a7", "content-length": "26", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61282024-11-08T01:36:11.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61292024-11-08T01:36:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.853312ms iteration = 26 status = null
61302024-11-08T01:36:11.500ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
61312024-11-08T01:36:11.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61322024-11-08T01:36:11.502ZDEBGnexus (BackgroundTasks): client response SledAgent = 979cd0c3-718d-49ed-b7c9-9ea81462754d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef49d7e0-e335-49e8-98e0-98e33ce587f3", "content-length": "691", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61332024-11-08T01:36:11.502ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61342024-11-08T01:36:11.502ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61352024-11-08T01:36:11.502ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61362024-11-08T01:36:11.504ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 229.402104ms iteration = 27 status = {}
61372024-11-08T01:36:11.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61382024-11-08T01:36:11.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61392024-11-08T01:36:11.593ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8319d8f0-da8a-4391-80c3-9a543a5517d3, rack_id: c39fc320-fcf4-4bad-aa4d-88a6f3278837, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(82df8f74-cffd-4f27-a0cf-85d5ffc72395) } rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
61402024-11-08T01:36:11.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61412024-11-08T01:36:11.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61422024-11-08T01:36:11.600ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61432024-11-08T01:36:11.601ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "547b6db0-94eb-4f99-94e2-b3ffa5de5b4b", "content-length": "134", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61442024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61452024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 82df8f74-cffd-4f27-a0cf-85d5ffc72395
61462024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61472024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61482024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61492024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61502024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61512024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61522024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61532024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61542024-11-08T01:36:11.601ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837
61552024-11-08T01:36:11.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61562024-11-08T01:36:11.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61572024-11-08T01:36:11.603ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61582024-11-08T01:36:11.603ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f318c90-8b08-466a-93fb-23d496ff6aa2", "content-length": "2", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61592024-11-08T01:36:11.603ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61602024-11-08T01:36:11.604ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e682581-4f7a-41ea-9266-aeebf50ea785", "content-length": "52", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61612024-11-08T01:36:11.604ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch_location = Switch0
61622024-11-08T01:36:11.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61632024-11-08T01:36:11.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "87446727-5563-499a-8e67-b688a14bd2b1", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61642024-11-08T01:36:11.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 switch = Switch0
61652024-11-08T01:36:11.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61662024-11-08T01:36:11.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c39fc320-fcf4-4bad-aa4d-88a6f3278837 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8968f27-665c-4a59-a500-9d95af159586", "content-length": "682", "date": "Fri, 08 Nov 2024 01:36:11 GMT"} })
61672024-11-08T01:36:11.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61682024-11-08T01:36:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61692024-11-08T01:36:11.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61702024-11-08T01:36:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61712024-11-08T01:36:11.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61722024-11-08T01:36:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61732024-11-08T01:36:11.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61742024-11-08T01:36:11.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61752024-11-08T01:36:11.771ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.633245ms iteration = 26 status = {}
61762024-11-08T01:36:11.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f97a8164-64cc-46f5-b8c9-a4be581068ee roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61772024-11-08T01:36:11.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f97a8164-64cc-46f5-b8c9-a4be581068ee resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61782024-11-08T01:36:11.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f97a8164-64cc-46f5-b8c9-a4be581068ee response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61792024-11-08T01:36:12.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a6f414-a664-48f3-9526-d3dcf76d0d2f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61802024-11-08T01:36:12.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a6f414-a664-48f3-9526-d3dcf76d0d2f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61812024-11-08T01:36:12.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 82a6f414-a664-48f3-9526-d3dcf76d0d2f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61822024-11-08T01:36:13.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f08cdb-70eb-4f85-80ec-98a73b5510d8 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61832024-11-08T01:36:13.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f08cdb-70eb-4f85-80ec-98a73b5510d8 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61842024-11-08T01:36:13.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e4f08cdb-70eb-4f85-80ec-98a73b5510d8 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61852024-11-08T01:36:14.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 98622f5c-2853-4459-834f-4979a891a9d9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
61862024-11-08T01:36:14.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 98622f5c-2853-4459-834f-4979a891a9d9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
61872024-11-08T01:36:14.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33713 req_id = 98622f5c-2853-4459-834f-4979a891a9d9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
61882024-11-08T01:36:14.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9305269c-7d90-45d8-afdd-5b2a5e060385 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61892024-11-08T01:36:14.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9305269c-7d90-45d8-afdd-5b2a5e060385 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61902024-11-08T01:36:15.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9305269c-7d90-45d8-afdd-5b2a5e060385 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61912024-11-08T01:36:15.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = e7d46cde-9a89-457f-9f26-e393db5f09bd response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
61922024-11-08T01:36:16.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0e1197f-419d-4a85-9c48-2dc16d033fd0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61932024-11-08T01:36:16.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0e1197f-419d-4a85-9c48-2dc16d033fd0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61942024-11-08T01:36:16.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = d0e1197f-419d-4a85-9c48-2dc16d033fd0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61952024-11-08T01:36:17.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71cbfd74-5912-4beb-873b-63289f5022e3 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61962024-11-08T01:36:17.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71cbfd74-5912-4beb-873b-63289f5022e3 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61972024-11-08T01:36:17.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 71cbfd74-5912-4beb-873b-63289f5022e3 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61982024-11-08T01:36:18.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eb1c77ef-b226-48b8-8bf2-a70f8501cf6a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
61992024-11-08T01:36:18.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eb1c77ef-b226-48b8-8bf2-a70f8501cf6a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62002024-11-08T01:36:18.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = eb1c77ef-b226-48b8-8bf2-a70f8501cf6a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62012024-11-08T01:36:19.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a600141-c50e-41f7-9afc-d92c583f3c18 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62022024-11-08T01:36:19.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a600141-c50e-41f7-9afc-d92c583f3c18 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62032024-11-08T01:36:19.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 6a600141-c50e-41f7-9afc-d92c583f3c18 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62042024-11-08T01:36:20.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcedac7d-efa6-459d-95d5-7eece3aadf3a roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62052024-11-08T01:36:20.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcedac7d-efa6-459d-95d5-7eece3aadf3a resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62062024-11-08T01:36:20.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bcedac7d-efa6-459d-95d5-7eece3aadf3a response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62072024-11-08T01:36:21.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 201a45dc-9958-4ebe-8abe-9a70c9ad742b roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62082024-11-08T01:36:21.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 201a45dc-9958-4ebe-8abe-9a70c9ad742b resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62092024-11-08T01:36:21.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 201a45dc-9958-4ebe-8abe-9a70c9ad742b response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62102024-11-08T01:36:21.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
62112024-11-08T01:36:21.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
62122024-11-08T01:36:21.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62132024-11-08T01:36:21.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62142024-11-08T01:36:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62152024-11-08T01:36:21.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62162024-11-08T01:36:21.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62172024-11-08T01:36:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62182024-11-08T01:36:21.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-11-08T01:36:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.507457ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62202024-11-08T01:36:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62212024-11-08T01:36:21.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62222024-11-08T01:36:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62232024-11-08T01:36:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62242024-11-08T01:36:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62252024-11-08T01:36:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62262024-11-08T01:36:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
62272024-11-08T01:36:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62282024-11-08T01:36:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62292024-11-08T01:36:21.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
62302024-11-08T01:36:21.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.60932ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
62312024-11-08T01:36:22.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = caa497d5-cd0b-4f55-86fe-eaf8afbef294 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62322024-11-08T01:36:22.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = caa497d5-cd0b-4f55-86fe-eaf8afbef294 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62332024-11-08T01:36:22.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = caa497d5-cd0b-4f55-86fe-eaf8afbef294 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62342024-11-08T01:36:23.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 65eba8f7-c7e7-4ac6-b692-0768f9c38b6d roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62352024-11-08T01:36:23.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 65eba8f7-c7e7-4ac6-b692-0768f9c38b6d resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62362024-11-08T01:36:23.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 65eba8f7-c7e7-4ac6-b692-0768f9c38b6d response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62372024-11-08T01:36:24.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aca9876f-ff89-472d-af9a-d1aaeffa060f roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62382024-11-08T01:36:24.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aca9876f-ff89-472d-af9a-d1aaeffa060f resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62392024-11-08T01:36:24.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = aca9876f-ff89-472d-af9a-d1aaeffa060f response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62402024-11-08T01:36:25.008ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57908
62412024-11-08T01:36:25.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57908 req_id = 07344747-1075-4085-9e33-36329e7b04ef roles = RoleSet { roles: {} } uri = /metrics/producers
62422024-11-08T01:36:25.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57908 req_id = 07344747-1075-4085-9e33-36329e7b04ef resource = Database result = Ok(()) uri = /metrics/producers
62432024-11-08T01:36:25.048ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 861af0e9-1a8a-48bd-a8ed-6c14b35576c5
62442024-11-08T01:36:25.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39868 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57908 req_id = 07344747-1075-4085-9e33-36329e7b04ef response_code = 201 uri = /metrics/producers
62452024-11-08T01:36:25.146ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55515
62462024-11-08T01:36:25.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55515 req_id = 7b9be867-32ce-43af-94d7-7cf865badb79 roles = RoleSet { roles: {} } uri = /metrics/producers
62472024-11-08T01:36:25.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55515 req_id = 7b9be867-32ce-43af-94d7-7cf865badb79 resource = Database result = Ok(()) uri = /metrics/producers
62482024-11-08T01:36:25.183ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = ca74b71f-49fb-469a-9605-bfd58f47f205
62492024-11-08T01:36:25.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37284 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55515 req_id = 7b9be867-32ce-43af-94d7-7cf865badb79 response_code = 201 uri = /metrics/producers
62502024-11-08T01:36:25.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1d8e637b-113d-401a-9361-dfecf6a36608 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62512024-11-08T01:36:25.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1d8e637b-113d-401a-9361-dfecf6a36608 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62522024-11-08T01:36:25.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 1d8e637b-113d-401a-9361-dfecf6a36608 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62532024-11-08T01:36:26.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c848534-a33e-4f32-af90-e405a3143107 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62542024-11-08T01:36:26.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c848534-a33e-4f32-af90-e405a3143107 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62552024-11-08T01:36:26.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 9c848534-a33e-4f32-af90-e405a3143107 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62562024-11-08T01:36:26.813ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42840
62572024-11-08T01:36:26.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42840 req_id = 5bac51d2-d768-437b-b99f-fc39e6302136 roles = RoleSet { roles: {} } uri = /metrics/producers
62582024-11-08T01:36:26.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42840 req_id = 5bac51d2-d768-437b-b99f-fc39e6302136 resource = Database result = Ok(()) uri = /metrics/producers
62592024-11-08T01:36:26.822ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = 979cd0c3-718d-49ed-b7c9-9ea81462754d
62602024-11-08T01:36:26.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9093 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42840 req_id = 5bac51d2-d768-437b-b99f-fc39e6302136 response_code = 201 uri = /metrics/producers
62612024-11-08T01:36:27.180ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44222
62622024-11-08T01:36:27.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44222 req_id = f70e5608-5ed5-4937-8641-d7a1970e184a roles = RoleSet { roles: {} } uri = /metrics/producers
62632024-11-08T01:36:27.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44222 req_id = f70e5608-5ed5-4937-8641-d7a1970e184a resource = Database result = Ok(()) uri = /metrics/producers
62642024-11-08T01:36:27.189ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = cb06a8fc-af98-4e26-90a6-5c333714c8a7
62652024-11-08T01:36:27.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9038 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44222 req_id = f70e5608-5ed5-4937-8641-d7a1970e184a response_code = 201 uri = /metrics/producers
62662024-11-08T01:36:27.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 329399d1-49f5-4056-96a3-2ab36bfdfbd0 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62672024-11-08T01:36:27.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 329399d1-49f5-4056-96a3-2ab36bfdfbd0 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62682024-11-08T01:36:27.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 329399d1-49f5-4056-96a3-2ab36bfdfbd0 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62692024-11-08T01:36:28.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 802c956a-8095-4f03-b03d-f5a481e66e74 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62702024-11-08T01:36:28.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 802c956a-8095-4f03-b03d-f5a481e66e74 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62712024-11-08T01:36:28.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 802c956a-8095-4f03-b03d-f5a481e66e74 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62722024-11-08T01:36:29.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f27bae49-65c7-48e8-9cad-2b1b781db691 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62732024-11-08T01:36:29.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f27bae49-65c7-48e8-9cad-2b1b781db691 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62742024-11-08T01:36:29.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = f27bae49-65c7-48e8-9cad-2b1b781db691 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62752024-11-08T01:36:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1394 local_addr = [fd00:1122:3344:101::b]:37003 method = GET remote_addr = [fd00:1122:3344:101::d]:40611 req_id = 96ada402-61ba-442c-ac5e-5a80dbddc33f response_code = 200 uri = /342fecfa-d739-42a3-a354-8b70b3c745ce
62762024-11-08T01:36:30.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf041858-0791-44e0-be08-b2423a566df6 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62772024-11-08T01:36:30.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf041858-0791-44e0-be08-b2423a566df6 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62782024-11-08T01:36:30.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = bf041858-0791-44e0-be08-b2423a566df6 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
62792024-11-08T01:36:31.275ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
62802024-11-08T01:36:31.275ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
62812024-11-08T01:36:31.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62822024-11-08T01:36:31.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62832024-11-08T01:36:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62842024-11-08T01:36:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62852024-11-08T01:36:31.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62862024-11-08T01:36:31.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62872024-11-08T01:36:31.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62882024-11-08T01:36:31.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62892024-11-08T01:36:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62902024-11-08T01:36:31.280ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.822555ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62912024-11-08T01:36:31.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62922024-11-08T01:36:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62932024-11-08T01:36:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62942024-11-08T01:36:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952024-11-08T01:36:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 31c30021-27d0-4144-b370-020b716fe22c, lookup_type: ById(31c30021-27d0-4144-b370-020b716fe22c) } result = Ok(())
62962024-11-08T01:36:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62972024-11-08T01:36:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62982024-11-08T01:36:31.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 31c30021-27d0-4144-b370-020b716fe22c original_time_created = 2024-11-08 01:23:41.194083 UTC target_id = 31c30021-27d0-4144-b370-020b716fe22c time_created = 2024-11-08 01:23:41.194083 UTC
62992024-11-08T01:36:31.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.63515ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"31c30021-27d0-4144-b370-020b716fe22c","time_created":"2024-11-08T01:23:41.194083Z"}
63002024-11-08T01:36:31.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 699335ab-b5b2-41ea-becc-01225727a9eb roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63012024-11-08T01:36:31.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 699335ab-b5b2-41ea-becc-01225727a9eb resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63022024-11-08T01:36:31.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 699335ab-b5b2-41ea-becc-01225727a9eb response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63032024-11-08T01:36:31.447ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34967
63042024-11-08T01:36:31.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34967 req_id = 58180123-33f9-4a9c-bf60-bb26f6a86077 roles = RoleSet { roles: {} } uri = /metrics/producers
63052024-11-08T01:36:31.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34967 req_id = 58180123-33f9-4a9c-bf60-bb26f6a86077 resource = Database result = Ok(()) uri = /metrics/producers
63062024-11-08T01:36:31.480ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = f8b5c8d6-6ffd-4c5c-afa2-474a8cf9ea92
63072024-11-08T01:36:31.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33042 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34967 req_id = 58180123-33f9-4a9c-bf60-bb26f6a86077 response_code = 201 uri = /metrics/producers
63082024-11-08T01:36:32.366ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42856
63092024-11-08T01:36:32.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42856 req_id = ef50cd32-bc16-4490-aa35-6209baad24a2 roles = RoleSet { roles: {} } uri = /metrics/producers
63102024-11-08T01:36:32.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42856 req_id = ef50cd32-bc16-4490-aa35-6209baad24a2 resource = Database result = Ok(()) uri = /metrics/producers
63112024-11-08T01:36:32.406ZINFOnexus: assigned collector to new producer collector_id = f8eb2395-07f4-4cb9-b50e-c37d78d1725d file = nexus/src/app/oximeter.rs:76 producer_id = d7ca6535-bec2-4045-807b-1d2c3d385a99
63122024-11-08T01:36:32.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39988 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42856 req_id = ef50cd32-bc16-4490-aa35-6209baad24a2 response_code = 201 uri = /metrics/producers
63132024-11-08T01:36:32.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e0adaa99-bdaf-4251-a1fd-0de6226f9daf roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63142024-11-08T01:36:32.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e0adaa99-bdaf-4251-a1fd-0de6226f9daf resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63152024-11-08T01:36:32.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = e0adaa99-bdaf-4251-a1fd-0de6226f9daf response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63162024-11-08T01:36:33.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c35dcde-fddf-478c-ad31-5aae65b48fde roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63172024-11-08T01:36:33.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c35dcde-fddf-478c-ad31-5aae65b48fde resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63182024-11-08T01:36:33.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 5c35dcde-fddf-478c-ad31-5aae65b48fde response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63192024-11-08T01:36:34.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 67c975f5-ff0a-4d33-a401-1a26a2e82834 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63202024-11-08T01:36:34.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 67c975f5-ff0a-4d33-a401-1a26a2e82834 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63212024-11-08T01:36:34.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 67c975f5-ff0a-4d33-a401-1a26a2e82834 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63222024-11-08T01:36:35.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0ac3c1cc-6d61-4872-8e31-2304d169be20 roles = RoleSet { roles: {} } uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63232024-11-08T01:36:35.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0ac3c1cc-6d61-4872-8e31-2304d169be20 resource = Database result = Ok(()) uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d
63242024-11-08T01:36:35.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34859 req_id = 0ac3c1cc-6d61-4872-8e31-2304d169be20 response_code = 200 uri = /probes/979cd0c3-718d-49ed-b7c9-9ea81462754d